Nov 29 18:56:44 user nova-compute[75235]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75235) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75235) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75235) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 18:56:44 user nova-compute[75235]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 18:56:44 user nova-compute[75235]: INFO nova.virt.driver [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 18:56:44 user nova-compute[75235]: INFO nova.compute.provider_config [None req-21184694-5f75-404b-887d-e52fd980d32d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Acquiring lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Acquired lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Releasing lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Full set of CONF: {{(pid=75235) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ******************************************************************************** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Configuration options gathered from: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ================================================================================ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] allow_resize_to_same_host      = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] arq_binding_timeout            = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] backdoor_port                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] backdoor_socket                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] block_device_allocate_retries  = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] block_device_allocate_retries_interval = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cert                           = self.pem {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute_monitors               = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] config_dir                     = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] config_drive_format            = iso9660 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] config_source                  = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] console_host                   = user {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] control_exchange               = nova {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cpu_allocation_ratio           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] daemon                         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] debug                          = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] default_access_ip_network_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] default_availability_zone      = nova {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] default_ephemeral_format       = ext4 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] default_green_pool_size        = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] default_schedule_zone          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] disk_allocation_ratio          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] enable_new_services            = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] enabled_apis                   = ['osapi_compute'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] enabled_ssl_apis               = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] flat_injected                  = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] force_config_drive             = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] force_raw_images               = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] graceful_shutdown_timeout      = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] heal_instance_info_cache_interval = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] host                           = user {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_build_timeout         = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_delete_interval       = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_format                = [instance: %(uuid)s]  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_name_template         = instance-%08x {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_usage_audit           = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_usage_audit_period    = month {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] internal_service_availability_zone = internal {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] key                            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] live_migration_retry_count     = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_config_append              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_dir                        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_file                       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_options                    = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_rotate_interval            = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_rotate_interval_type       = days {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] log_rotation_type              = none {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] long_rpc_timeout               = 1800 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] max_concurrent_builds          = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] max_concurrent_live_migrations = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] max_concurrent_snapshots       = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] max_local_block_devices        = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] max_logfile_count              = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] max_logfile_size_mb            = 200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] maximum_instance_delete_attempts = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metadata_listen                = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metadata_listen_port           = 8775 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metadata_workers               = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] migrate_max_retries            = -1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] mkisofs_cmd                    = genisoimage {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] my_ip                          = 10.0.0.210 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] network_allocate_retries       = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] osapi_compute_listen_port      = 8774 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] osapi_compute_unique_server_name_scope =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] osapi_compute_workers          = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] password_length                = 12 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] periodic_enable                = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] periodic_fuzzy_delay           = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] pointer_model                  = ps2mouse {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] preallocate_images             = none {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] publish_errors                 = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] pybasedir                      = /opt/stack/nova {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ram_allocation_ratio           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rate_limit_burst               = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rate_limit_except_level        = CRITICAL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rate_limit_interval            = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reboot_timeout                 = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reclaim_instance_interval      = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] record                         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reimage_timeout_per_gb         = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] report_interval                = 120 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rescue_timeout                 = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reserved_host_cpus             = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reserved_host_disk_mb          = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reserved_host_memory_mb        = 512 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] reserved_huge_pages            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] resize_confirm_window          = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] resize_fs_using_block_device   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] resume_guests_state_on_host_boot = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rpc_response_timeout           = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] run_external_periodic_tasks    = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] running_deleted_instance_action = reap {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] running_deleted_instance_poll_interval = 1800 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] running_deleted_instance_timeout = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler_instance_sync_interval = 120 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_down_time              = 720 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] servicegroup_driver            = db {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] shelved_offload_time           = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] shelved_poll_interval          = 3600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] shutdown_timeout               = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] source_is_ipv6                 = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ssl_only                       = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] state_path                     = /opt/stack/data/nova {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] sync_power_state_interval      = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] sync_power_state_pool_size     = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] syslog_log_facility            = LOG_USER {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] tempdir                        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] timeout_nbd                    = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] transport_url                  = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] update_resources_interval      = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_cow_images                 = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_eventlog                   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_journal                    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_json                       = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_rootwrap_daemon            = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_stderr                     = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] use_syslog                     = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vcpu_pin_set                   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plugging_is_fatal          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plugging_timeout           = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] virt_mkfs                      = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] volume_usage_poll_interval     = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] watch_log_file                 = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] web                            = /usr/share/spice-html5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_concurrency.disable_process_locking = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.auth_strategy              = keystone {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.compute_link_prefix        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.dhcp_domain                = novalocal {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.enable_instance_password   = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.glance_link_prefix         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.instance_list_per_project_cells = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.list_records_by_skipping_down_cells = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.local_metadata_per_cell    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.max_limit                  = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.metadata_cache_expiration  = 15 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.neutron_default_tenant_id  = default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.use_forwarded_for          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.use_neutron_default_nets   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_dynamic_targets = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_jsonfile_path   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.backend                  = dogpile.cache.memcached {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.backend_argument         = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.config_prefix            = cache.oslo {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.dead_timeout             = 60.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.debug_cache_backend      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.enable_retry_client      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.enable_socket_keepalive  = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.enabled                  = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.expiration_time          = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.hashclient_retry_attempts = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_dead_retry      = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_password        =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_pool_maxsize    = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_sasl_enabled    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.memcache_username        =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.proxies                  = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.retry_attempts           = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.retry_delay              = 0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.socket_keepalive_count   = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.socket_keepalive_idle    = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.socket_keepalive_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.tls_allowed_ciphers      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.tls_cafile               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.tls_certfile             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.tls_enabled              = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cache.tls_keyfile              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.auth_section            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.auth_type               = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.cafile                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.certfile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.collect_timing          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.cross_az_attach         = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.debug                   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.endpoint_template       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.http_retries            = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.insecure                = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.keyfile                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.os_region_name          = RegionOne {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.split_loggers           = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cinder.timeout                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.cpu_dedicated_set      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.cpu_shared_set         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.image_type_exclude_list = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.max_concurrent_disk_ops = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.max_disk_devices_to_attach = -1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.resource_provider_association_refresh = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.shutdown_retry_interval = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] conductor.workers              = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] console.allowed_origins        = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] console.ssl_ciphers            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] console.ssl_minimum_version    = default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] consoleauth.token_ttl          = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.cafile                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.certfile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.collect_timing          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.connect_retries         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.connect_retry_delay     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.endpoint_override       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.insecure                = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.keyfile                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.max_version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.min_version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.region_name             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.service_name            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.service_type            = accelerator {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.split_loggers           = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.status_code_retries     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.timeout                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] cyborg.version                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.backend               = sqlalchemy {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.connection            = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.connection_debug      = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.connection_parameters =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.connection_recycle_time = 3600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.connection_trace      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.db_inc_retry_interval = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.db_max_retries        = 20 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.db_max_retry_interval = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.db_retry_interval     = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.max_overflow          = 50 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.max_pool_size         = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.max_retries           = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.mysql_wsrep_sync_wait = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.pool_timeout          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.retry_interval        = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.slave_connection      = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] database.sqlite_synchronous    = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.backend           = sqlalchemy {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.connection        = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.connection_debug  = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.connection_parameters =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.connection_recycle_time = 3600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.connection_trace  = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.db_inc_retry_interval = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.db_max_retries    = 20 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.db_max_retry_interval = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.db_retry_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.max_overflow      = 50 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.max_pool_size     = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.max_retries       = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.pool_timeout      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.retry_interval    = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:44 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.slave_connection  = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] api_database.sqlite_synchronous = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] devices.enabled_mdev_types     = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ephemeral_storage_encryption.enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.api_servers             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.cafile                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.certfile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.collect_timing          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.connect_retries         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.connect_retry_delay     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.debug                   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.default_trusted_certificate_ids = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.enable_certificate_validation = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.enable_rbd_download     = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.endpoint_override       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.insecure                = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.keyfile                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.max_version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.min_version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.num_retries             = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.rbd_ceph_conf           =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.rbd_connect_timeout     = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.rbd_pool                =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.rbd_user                =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.region_name             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.service_name            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.service_type            = image {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.split_loggers           = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.status_code_retries     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.timeout                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.verify_glance_signatures = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] glance.version                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] guestfs.debug                  = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.config_drive_cdrom      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.config_drive_inject_password = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.enable_instance_metrics_collection = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.enable_remotefx         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.instances_path_share    =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.iscsi_initiator_list    = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.limit_cpu_features      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.power_state_check_timeframe = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.use_multipath_io        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.volume_attach_retry_count = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.vswitch_name            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] mks.enabled                    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] image_cache.manager_interval   = 2400 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] image_cache.precache_concurrency = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] image_cache.remove_unused_base_images = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] image_cache.subdirectory_name  = _base {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.api_max_retries         = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.api_retry_interval      = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.auth_section            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.auth_type               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.cafile                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.certfile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.collect_timing          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.conductor_group         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.connect_retries         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.connect_retry_delay     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.endpoint_override       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.insecure                = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.keyfile                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.max_version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.min_version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.peer_list               = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.region_name             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.serial_console_state_timeout = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.service_name            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.service_type            = baremetal {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.split_loggers           = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.status_code_retries     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.timeout                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ironic.version                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] key_manager.fixed_key          = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.barbican_api_version  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.barbican_endpoint     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.barbican_endpoint_type = public {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.barbican_region_name  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.cafile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.certfile              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.collect_timing        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.insecure              = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.keyfile               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.number_of_retries     = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.retry_delay           = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.send_service_user_token = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.split_loggers         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.timeout               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.verify_ssl            = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican.verify_ssl_path       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.auth_section = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.auth_type = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.cafile   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.collect_timing = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.keyfile  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] barbican_service_user.timeout  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.approle_role_id          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.approle_secret_id        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.cafile                   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.certfile                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.collect_timing           = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.insecure                 = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.keyfile                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.kv_mountpoint            = secret {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.kv_path                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.kv_version               = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.namespace                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.root_token_id            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.split_loggers            = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.ssl_ca_crt_file          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.timeout                  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.use_ssl                  = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.auth_section          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.auth_type             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.cafile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.certfile              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.collect_timing        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.connect_retries       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.connect_retry_delay   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.endpoint_override     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.insecure              = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.keyfile               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.max_version           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.min_version           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.region_name           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.service_name          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.service_type          = identity {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.split_loggers         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.status_code_retries   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.timeout               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] keystone.version               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.connection_uri         =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_mode               = custom {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: WARNING oslo_config.cfg [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_power_governor_high = performance {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_power_governor_low = powersave {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_power_management   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.device_detach_attempts = 8 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.device_detach_timeout  = 20 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.disk_cachemodes        = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.disk_prefix            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.enabled_perf_events    = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.file_backed_memory     = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.gid_maps               = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.hw_disk_discard        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.hw_machine_type        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_rbd_glance_store_name =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_rbd_pool        = rbd {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_type            = default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.images_volume_group    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.inject_key             = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.inject_partition       = -2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.inject_password        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.iscsi_iface            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.iser_use_multipath     = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_bandwidth = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_downtime = 500 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_inbound_addr = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_permit_post_copy = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_scheme  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_timeout_action = abort {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_tunnelled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: WARNING oslo_config.cfg [None req-21184694-5f75-404b-887d-e52fd980d32d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 18:56:45 user nova-compute[75235]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 18:56:45 user nova-compute[75235]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 18:56:45 user nova-compute[75235]: and ``live_migration_inbound_addr`` respectively.
Nov 29 18:56:45 user nova-compute[75235]: ).  Its value may be silently ignored in the future.
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.live_migration_with_native_tls = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.max_queues             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.nfs_mount_options      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.num_memory_encrypted_guests = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.num_pcie_ports         = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.pmem_namespaces        = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.quobyte_client_cfg     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rbd_secret_uuid        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rbd_user               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.remote_filesystem_transport = ssh {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rescue_image_id        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rescue_kernel_id       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rescue_ramdisk_id      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.rx_queue_size          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.smbfs_mount_options    =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.snapshot_compression   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.snapshot_image_format  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.sparse_logical_volumes = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.swtpm_enabled          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.swtpm_group            = tss {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.swtpm_user             = tss {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.sysinfo_serial         = unique {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.tb_cache_size          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.tx_queue_size          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.uid_maps               = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.use_virtio_for_bridges = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.virt_type              = kvm {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.volume_clear           = zero {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.volume_clear_size      = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.volume_use_multipath   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_cache_path   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.vzstorage_mount_user   = stack {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.auth_section           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.auth_type              = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.cafile                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.certfile               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.collect_timing         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.connect_retries        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.connect_retry_delay    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.default_floating_pool  = public {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.endpoint_override      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.extension_sync_interval = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.http_retries           = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.insecure               = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.keyfile                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.max_version            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.min_version            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.ovs_bridge             = br-int {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.physnets               = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.region_name            = RegionOne {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.service_metadata_proxy = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.service_name           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.service_type           = network {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.split_loggers          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.status_code_retries    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.timeout                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] neutron.version                = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] notifications.bdms_in_notifications = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] notifications.default_level    = INFO {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] notifications.notification_format = unversioned {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] notifications.notify_on_state_change = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] pci.alias                      = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] pci.device_spec                = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] pci.report_in_placement        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.auth_section         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.auth_type            = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.cafile               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.certfile             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.collect_timing       = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.connect_retries      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.connect_retry_delay  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.default_domain_id    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.default_domain_name  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.domain_id            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.domain_name          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.endpoint_override    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.insecure             = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.keyfile              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.max_version          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.min_version          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.password             = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.project_domain_id    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.project_domain_name  = Default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.project_id           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.project_name         = service {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.region_name          = RegionOne {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.service_name         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.service_type         = placement {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.split_loggers        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.status_code_retries  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.system_scope         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.timeout              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.trust_id             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.user_domain_id       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.user_domain_name     = Default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.user_id              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.username             = placement {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] placement.version              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.cores                    = 20 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.count_usage_from_placement = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.injected_file_content_bytes = 10240 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.injected_file_path_length = 255 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.injected_files           = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.instances                = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.key_pairs                = 100 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.metadata_items           = 128 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.ram                      = 51200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.recheck_quota            = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.server_group_members     = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] quota.server_groups            = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rdp.enabled                    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.image_metadata_prefilter = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.max_attempts         = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.max_placement_results = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.query_placement_for_image_type_support = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] scheduler.workers              = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.host_subset_size = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.isolated_hosts = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.isolated_images = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.pci_in_placement = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.track_instance_changes = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metrics.required               = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metrics.weight_multiplier      = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] metrics.weight_setting         = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] serial_console.enabled         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] serial_console.port_range      = 10000:20000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] serial_console.serialproxy_port = 6083 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.auth_section      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.auth_type         = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.cafile            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.certfile          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.collect_timing    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.insecure          = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.keyfile           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.send_service_user_token = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.split_loggers     = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] service_user.timeout           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.agent_enabled            = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.enabled                  = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.html5proxy_port          = 6082 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.image_compression        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.jpeg_compression         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.playback_compression     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.server_listen            = 127.0.0.1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.streaming_mode           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] spice.zlib_compression         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] upgrade_levels.baseapi         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] upgrade_levels.compute         = auto {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] upgrade_levels.conductor       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] upgrade_levels.scheduler       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.auth_section = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.auth_type = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.cafile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vendordata_dynamic_auth.timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.api_retry_count         = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.ca_file                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.cache_prefix            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.cluster_name            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.connection_pool_size    = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.console_delay_seconds   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.datastore_regex         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.host_ip                 = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.host_password           = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.host_port               = 443 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.host_username           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.insecure                = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.integration_bridge      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.maximum_objects         = 100 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.pbm_default_policy      = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.pbm_enabled             = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.pbm_wsdl_location       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.serial_port_proxy_uri   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.serial_port_service_uri = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.task_poll_interval      = 0.5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.use_linked_clone        = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.vnc_keymap              = en-us {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.vnc_port                = 5900 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vmware.vnc_port_total          = 10000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.auth_schemes               = ['none'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.enabled                    = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.novncproxy_port            = 6080 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.server_listen              = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.vencrypt_ca_certs          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.vencrypt_client_cert       = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vnc.vencrypt_client_key        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.disable_rootwrap   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.enable_numa_live_migration = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.libvirt_disable_apic = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.client_socket_timeout     = 900 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.default_pool_size         = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.keep_alive                = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.max_header_line           = 16384 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.ssl_ca_file               = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.ssl_cert_file             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.ssl_key_file              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.tcp_keepidle              = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] zvm.ca_file                    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] zvm.cloud_connector_url        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] zvm.reachable_timeout          = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.enforce_new_defaults = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.enforce_scope      = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.policy_default_rule = default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.policy_file        = policy.yaml {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.connection_string     = messaging:// {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.enabled               = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.es_doc_type           = notification {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.es_scroll_size        = 10000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.es_scroll_time        = 2m {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.filter_error_trace    = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.hmac_keys             = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.sentinel_service_name = mymaster {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.socket_timeout        = 0.1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.trace_requests        = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler.trace_sqlalchemy      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler_jaeger.process_tags   = {} {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler_jaeger.service_name_prefix = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] profiler_otlp.service_name_prefix = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] remote_debug.host              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] remote_debug.port              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.ssl      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_notifications.retry = -1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.auth_section        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.auth_type           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.cafile              = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.certfile            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.collect_timing      = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.connect_retries     = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.connect_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.endpoint_id         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.endpoint_override   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.insecure            = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.keyfile             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.max_version         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.min_version         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.region_name         = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.service_name        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.service_type        = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.split_loggers       = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.status_code_retries = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.status_code_retry_delay = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.timeout             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.valid_interfaces    = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_limit.version             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_reports.file_event_handler = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] oslo_reports.log_dir           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_ovs_privileged.group  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] vif_plug_ovs_privileged.user   = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.flat_interface = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.isolate_vif         = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_vif_ovs.per_port_bridge     = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] os_brick.lock_path             = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] privsep_osbrick.capabilities   = [21] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] privsep_osbrick.group          = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] privsep_osbrick.helper_command = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] privsep_osbrick.user           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] nova_sys_admin.group           = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] nova_sys_admin.helper_command  = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] nova_sys_admin.user            = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG oslo_service.service [None req-21184694-5f75-404b-887d-e52fd980d32d None None] ******************************************************************************** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 18:56:45 user nova-compute[75235]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Connecting to libvirt: qemu:///system {{(pid=75235) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f56595b2410> {{(pid=75235) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 18:56:45 user nova-compute[75235]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 18:56:45 user nova-compute[75235]: WARNING nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f56595b2410> {{(pid=75235) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Starting native event thread {{(pid=75235) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Starting green dispatch thread {{(pid=75235) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Starting connection event dispatch thread {{(pid=75235) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 18:56:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Connection event '1' reason 'None'
Nov 29 18:56:45 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 18:56:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.mount [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Initialising _HostMountState generation 0 {{(pid=75235) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 18:56:52 user nova-compute[75235]: INFO nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host capabilities <capabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <host>
Nov 29 18:56:52 user nova-compute[75235]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 18:56:52 user nova-compute[75235]:     <cpu>
Nov 29 18:56:52 user nova-compute[75235]:       <arch>x86_64</arch>
Nov 29 18:56:52 user nova-compute[75235]:       <model>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <microcode version='1070'/>
Nov 29 18:56:52 user nova-compute[75235]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='osxsave'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='invtsc'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='rsba'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 18:56:52 user nova-compute[75235]:       <pages unit='KiB' size='4'/>
Nov 29 18:56:52 user nova-compute[75235]:       <pages unit='KiB' size='2048'/>
Nov 29 18:56:52 user nova-compute[75235]:     </cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <power_management>
Nov 29 18:56:52 user nova-compute[75235]:       <suspend_mem/>
Nov 29 18:56:52 user nova-compute[75235]:       <suspend_disk/>
Nov 29 18:56:52 user nova-compute[75235]:       <suspend_hybrid/>
Nov 29 18:56:52 user nova-compute[75235]:     </power_management>
Nov 29 18:56:52 user nova-compute[75235]:     <iommu support='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <migration_features>
Nov 29 18:56:52 user nova-compute[75235]:       <live/>
Nov 29 18:56:52 user nova-compute[75235]:       <uri_transports>
Nov 29 18:56:52 user nova-compute[75235]:         <uri_transport>tcp</uri_transport>
Nov 29 18:56:52 user nova-compute[75235]:         <uri_transport>rdma</uri_transport>
Nov 29 18:56:52 user nova-compute[75235]:       </uri_transports>
Nov 29 18:56:52 user nova-compute[75235]:     </migration_features>
Nov 29 18:56:52 user nova-compute[75235]:     <topology>
Nov 29 18:56:52 user nova-compute[75235]:       <cells num='2'>
Nov 29 18:56:52 user nova-compute[75235]:         <cell id='0'>
Nov 29 18:56:52 user nova-compute[75235]:           <memory unit='KiB'>8140616</memory>
Nov 29 18:56:52 user nova-compute[75235]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 29 18:56:52 user nova-compute[75235]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 18:56:52 user nova-compute[75235]:           <distances>
Nov 29 18:56:52 user nova-compute[75235]:             <sibling id='0' value='10'/>
Nov 29 18:56:52 user nova-compute[75235]:             <sibling id='1' value='20'/>
Nov 29 18:56:52 user nova-compute[75235]:           </distances>
Nov 29 18:56:52 user nova-compute[75235]:           <cpus num='6'>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 18:56:52 user nova-compute[75235]:           </cpus>
Nov 29 18:56:52 user nova-compute[75235]:         </cell>
Nov 29 18:56:52 user nova-compute[75235]:         <cell id='1'>
Nov 29 18:56:52 user nova-compute[75235]:           <memory unit='KiB'>8255100</memory>
Nov 29 18:56:52 user nova-compute[75235]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 29 18:56:52 user nova-compute[75235]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 18:56:52 user nova-compute[75235]:           <distances>
Nov 29 18:56:52 user nova-compute[75235]:             <sibling id='0' value='20'/>
Nov 29 18:56:52 user nova-compute[75235]:             <sibling id='1' value='10'/>
Nov 29 18:56:52 user nova-compute[75235]:           </distances>
Nov 29 18:56:52 user nova-compute[75235]:           <cpus num='6'>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 18:56:52 user nova-compute[75235]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 18:56:52 user nova-compute[75235]:           </cpus>
Nov 29 18:56:52 user nova-compute[75235]:         </cell>
Nov 29 18:56:52 user nova-compute[75235]:       </cells>
Nov 29 18:56:52 user nova-compute[75235]:     </topology>
Nov 29 18:56:52 user nova-compute[75235]:     <cache>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 18:56:52 user nova-compute[75235]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 18:56:52 user nova-compute[75235]:     </cache>
Nov 29 18:56:52 user nova-compute[75235]:     <secmodel>
Nov 29 18:56:52 user nova-compute[75235]:       <model>apparmor</model>
Nov 29 18:56:52 user nova-compute[75235]:       <doi>0</doi>
Nov 29 18:56:52 user nova-compute[75235]:     </secmodel>
Nov 29 18:56:52 user nova-compute[75235]:     <secmodel>
Nov 29 18:56:52 user nova-compute[75235]:       <model>dac</model>
Nov 29 18:56:52 user nova-compute[75235]:       <doi>0</doi>
Nov 29 18:56:52 user nova-compute[75235]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 18:56:52 user nova-compute[75235]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 18:56:52 user nova-compute[75235]:     </secmodel>
Nov 29 18:56:52 user nova-compute[75235]:   </host>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='alpha'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>clipper</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='armv6l'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>spitz</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>nuri</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>kzm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sx1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>z2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>tosa</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>n810</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>n800</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>terrier</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>midway</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>microbit</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>verdex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>highbank</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>akita</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>connex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>collie</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='armv7l'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>spitz</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>nuri</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>kzm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sx1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>z2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>tosa</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>n810</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>n800</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>terrier</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>midway</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>microbit</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>verdex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>highbank</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>akita</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>connex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>collie</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='aarch64'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>spitz</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>nuri</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>kzm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sx1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>z2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>tosa</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>n810</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>n800</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>terrier</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>midway</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>microbit</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>verdex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>highbank</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>akita</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>connex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>collie</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <acpi default='on' toggle='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='cris'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='i686'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>isapc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>microvm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='kvm'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <pae/>
Nov 29 18:56:52 user nova-compute[75235]:       <nonpae/>
Nov 29 18:56:52 user nova-compute[75235]:       <acpi default='on' toggle='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:       <apic default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='m68k'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>an5206</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>q800</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='microblaze'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='microblazeel'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='mips'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='16'>malta</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='mipsel'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='16'>malta</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='mips64'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='16'>malta</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>pica61</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>magnum</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='mips64el'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='16'>malta</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>pica61</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>magnum</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='16'>boston</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='ppc'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mac99</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>40p</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>taihu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='ppc64'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>taihu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>40p</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mac99</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='ppc64le'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>taihu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>40p</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>mac99</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='riscv32'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='8'>spike</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='8'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='riscv64'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='8'>spike</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='8'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='s390x'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='sh4'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>shix</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>r2d</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='sh4eb'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>shix</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>r2d</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='sparc'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>LX</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='sparc64'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>niagara</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='x86_64'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>64</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='1'>isapc</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>microvm</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='kvm'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <acpi default='on' toggle='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:       <apic default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='xtensa'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>sim</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>kc705</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ml605</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx200</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx60</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]:   <guest>
Nov 29 18:56:52 user nova-compute[75235]:     <os_type>hvm</os_type>
Nov 29 18:56:52 user nova-compute[75235]:     <arch name='xtensaeb'>
Nov 29 18:56:52 user nova-compute[75235]:       <wordsize>32</wordsize>
Nov 29 18:56:52 user nova-compute[75235]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='4'>sim</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>kc705</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ml605</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>virt</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx200</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>lx60</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 18:56:52 user nova-compute[75235]:       <domain type='qemu'/>
Nov 29 18:56:52 user nova-compute[75235]:     </arch>
Nov 29 18:56:52 user nova-compute[75235]:     <features>
Nov 29 18:56:52 user nova-compute[75235]:       <cpuselection/>
Nov 29 18:56:52 user nova-compute[75235]:       <deviceboot/>
Nov 29 18:56:52 user nova-compute[75235]:       <disksnapshot default='on' toggle='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     </features>
Nov 29 18:56:52 user nova-compute[75235]:   </guest>
Nov 29 18:56:52 user nova-compute[75235]: </capabilities>
Nov 29 18:56:52 user nova-compute[75235]: 
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-q35-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>i686</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='288'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'/>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='lm'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-i440fx-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>i686</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='255'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'/>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='lm'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ide</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-i440fx-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>i686</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='255'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'/>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='lm'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ide</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-q35-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>i686</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='288'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'/>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='lm'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-q35-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>x86_64</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='288'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>efi</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='invtsc'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='rsba'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-i440fx-jammy</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>x86_64</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='255'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>efi</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='invtsc'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='rsba'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ide</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-i440fx-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>x86_64</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='255'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>efi</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='invtsc'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='rsba'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ide</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 18:56:52 user nova-compute[75235]: <domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 18:56:52 user nova-compute[75235]:   <domain>kvm</domain>
Nov 29 18:56:52 user nova-compute[75235]:   <machine>pc-q35-6.2</machine>
Nov 29 18:56:52 user nova-compute[75235]:   <arch>x86_64</arch>
Nov 29 18:56:52 user nova-compute[75235]:   <vcpu max='288'/>
Nov 29 18:56:52 user nova-compute[75235]:   <iothreads supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:   <os supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='firmware'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>efi</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:     <loader supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>rom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pflash</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='readonly'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='secure'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>yes</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>no</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </loader>
Nov 29 18:56:52 user nova-compute[75235]:   </os>
Nov 29 18:56:52 user nova-compute[75235]:   <cpu>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-passthrough' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='hostPassthroughMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='maximum' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='maximumMigratable'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>on</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>off</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='host-model' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <vendor>Intel</vendor>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ss'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='vmx'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pcid'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='hypervisor'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arat'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='umip'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='md-clear'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='invtsc'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibpb'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='ibrs'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-stibp'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='rsba'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='erms'/>
Nov 29 18:56:52 user nova-compute[75235]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:     <mode name='custom' supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>qemu64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>qemu32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>phenom</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>pentium</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>n270</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm64</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>kvm32</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>coreduo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>core2duo</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>athlon</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Westmere</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Snowridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Skylake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>SandyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Penryn</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G5</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G4</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G3</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Opteron_G2</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Opteron_G1</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>IvyBridge</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Icelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Haswell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Rome</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-Milan</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>EPYC</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Dhyana</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cooperlake</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>Conroe</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='no'>Broadwell</model>
Nov 29 18:56:52 user nova-compute[75235]:       <model usable='yes'>486</model>
Nov 29 18:56:52 user nova-compute[75235]:     </mode>
Nov 29 18:56:52 user nova-compute[75235]:   </cpu>
Nov 29 18:56:52 user nova-compute[75235]:   <memoryBacking supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:     <enum name='sourceType'>
Nov 29 18:56:52 user nova-compute[75235]:       <value>file</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>anonymous</value>
Nov 29 18:56:52 user nova-compute[75235]:       <value>memfd</value>
Nov 29 18:56:52 user nova-compute[75235]:     </enum>
Nov 29 18:56:52 user nova-compute[75235]:   </memoryBacking>
Nov 29 18:56:52 user nova-compute[75235]:   <devices>
Nov 29 18:56:52 user nova-compute[75235]:     <disk supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='diskDevice'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>disk</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cdrom</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>floppy</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>lun</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='bus'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>fdc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sata</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </disk>
Nov 29 18:56:52 user nova-compute[75235]:     <graphics supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='type'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>sdl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vnc</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>spice</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egl-headless</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </graphics>
Nov 29 18:56:52 user nova-compute[75235]:     <video supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='modelType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>cirrus</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>vmvga</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>qxl</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>none</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>bochs</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>ramfb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </video>
Nov 29 18:56:52 user nova-compute[75235]:     <hostdev supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='mode'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>subsystem</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='startupPolicy'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>default</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>mandatory</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>requisite</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>optional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='subsysType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>usb</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>pci</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>scsi</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='capsType'/>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='pciBackend'/>
Nov 29 18:56:52 user nova-compute[75235]:     </hostdev>
Nov 29 18:56:52 user nova-compute[75235]:     <rng supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtio-non-transitional</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>random</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>egd</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>builtin</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </rng>
Nov 29 18:56:52 user nova-compute[75235]:     <filesystem supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='driverType'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>path</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>handle</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>virtiofs</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </filesystem>
Nov 29 18:56:52 user nova-compute[75235]:     <tpm supported='yes'>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='model'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-tis</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>tpm-crb</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:       <enum name='backendModel'>
Nov 29 18:56:52 user nova-compute[75235]:         <value>passthrough</value>
Nov 29 18:56:52 user nova-compute[75235]:         <value>emulator</value>
Nov 29 18:56:52 user nova-compute[75235]:       </enum>
Nov 29 18:56:52 user nova-compute[75235]:     </tpm>
Nov 29 18:56:52 user nova-compute[75235]:   </devices>
Nov 29 18:56:52 user nova-compute[75235]:   <features>
Nov 29 18:56:52 user nova-compute[75235]:     <gic supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:     <vmcoreinfo supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <genid supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backingStoreInput supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <backup supported='yes'/>
Nov 29 18:56:52 user nova-compute[75235]:     <sev supported='no'/>
Nov 29 18:56:52 user nova-compute[75235]:   </features>
Nov 29 18:56:52 user nova-compute[75235]: </domainCapabilities>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75235) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75235) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Checking secure boot support for host arch (x86_64) {{(pid=75235) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 18:56:52 user nova-compute[75235]: INFO nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Secure Boot support detected
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] cpu compare xml: <cpu match="exact">
Nov 29 18:56:52 user nova-compute[75235]:   <model>Nehalem</model>
Nov 29 18:56:52 user nova-compute[75235]: </cpu>
Nov 29 18:56:52 user nova-compute[75235]:  {{(pid=75235) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 18:56:52 user nova-compute[75235]: INFO nova.virt.node [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Generated node identity 5d984797-93a3-43d0-9a35-bb500b1e869a
Nov 29 18:56:52 user nova-compute[75235]: INFO nova.virt.node [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Wrote node identity 5d984797-93a3-43d0-9a35-bb500b1e869a to /opt/stack/data/nova/compute_id
Nov 29 18:56:52 user nova-compute[75235]: WARNING nova.compute.manager [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Compute nodes ['5d984797-93a3-43d0-9a35-bb500b1e869a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 18:56:52 user nova-compute[75235]: INFO nova.compute.manager [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 18:56:52 user nova-compute[75235]: WARNING nova.compute.manager [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 18:56:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:56:52 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:56:53 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:56:53 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Hypervisor/Node resource view: name=user free_ram=10977MB free_disk=26.218486785888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:56:53 user nova-compute[75235]: WARNING nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] No compute node record for user:5d984797-93a3-43d0-9a35-bb500b1e869a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5d984797-93a3-43d0-9a35-bb500b1e869a could not be found.
Nov 29 18:56:53 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Compute node record created for user:user with uuid: 5d984797-93a3-43d0-9a35-bb500b1e869a
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:56:53 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] [req-0c0d92bd-4a78-4da0-94b1-165e4193ce10] Created resource provider record via placement API for resource provider with UUID 5d984797-93a3-43d0-9a35-bb500b1e869a and name user.
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75235) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 18:56:53 user nova-compute[75235]: INFO nova.virt.libvirt.host [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] kernel doesn't support AMD SEV
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Libvirt baseline CPU <cpu>
Nov 29 18:56:53 user nova-compute[75235]:   <arch>x86_64</arch>
Nov 29 18:56:53 user nova-compute[75235]:   <model>Nehalem</model>
Nov 29 18:56:53 user nova-compute[75235]:   <vendor>Intel</vendor>
Nov 29 18:56:53 user nova-compute[75235]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 18:56:53 user nova-compute[75235]: </cpu>
Nov 29 18:56:53 user nova-compute[75235]:  {{(pid=75235) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Updated inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Updating resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a generation from 0 to 1 during operation: update_inventory {{(pid=75235) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Updating resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a generation from 1 to 2 during operation: update_traits {{(pid=75235) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.service [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Creating RPC server for service compute {{(pid=75235) start /opt/stack/nova/nova/service.py:182}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.service [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] Join ServiceGroup membership for this service compute {{(pid=75235) start /opt/stack/nova/nova/service.py:199}}
Nov 29 18:56:53 user nova-compute[75235]: DEBUG nova.servicegroup.drivers.db [None req-56659e92-c0dd-43b7-ba72-f70410764146 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75235) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 18:57:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:57:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:57:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:57:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=10424MB free_disk=26.12225341796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:57:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:57:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:57:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:57:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:57:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:57:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:57:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:58:45 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:58:45 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=10348MB free_disk=26.187976837158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:58:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:58:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:58:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 18:59:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:59:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 18:59:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=10322MB free_disk=25.941192626953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 18:59:44 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 18:59:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 18:59:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 18:59:47 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 18:59:48 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:00:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:00:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:00:44 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=9672MB free_disk=25.968746185302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:00:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:00:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:00:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:00:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:00:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:00:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:00:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:00:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:00:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:00:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:00:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:48 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:48 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:48 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:00:49 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:49 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:49 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:00:59 user nova-compute[75235]: INFO nova.compute.claims [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Claim successful on node user
Nov 29 19:00:59 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:00:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Creating image(s)
Nov 29 19:01:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "/opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "/opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "/opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG nova.policy [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bc8bd57cf474a43a211fd6f87188baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9abbc576f624e2baa97407069b233b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.part --force-share --output=json" returned: 0 in 0.166s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG nova.virt.images [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] 2df0cf47-6e1a-495b-92f5-27a94d1b3217 was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.part /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.part /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.converted" returned: 0 in 0.126s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.132s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:01 user nova-compute[75235]: INFO oslo.privsep.daemon [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn4yaqgm5/privsep.sock']
Nov 29 19:01:01 user sudo[84479]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn4yaqgm5/privsep.sock
Nov 29 19:01:01 user sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 19:01:02 user nova-compute[75235]: DEBUG nova.network.neutron [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Successfully created port: d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:02 user sudo[84479]: pam_unix(sudo:session): session closed for user root
Nov 29 19:01:02 user nova-compute[75235]: INFO oslo.privsep.daemon [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Spawned new privsep daemon via rootwrap
Nov 29 19:01:02 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 19:01:02 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 19:01:02 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 19:01:02 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84484
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.156s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk 1073741824" returned: 0 in 0.039s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Cannot resize image /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Ensure instance console log exists: /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:05 user nova-compute[75235]: INFO nova.compute.claims [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Claim successful on node user
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Creating image(s)
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "/opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "/opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Successfully updated port: d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquired lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.policy [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2babb226c484046aab50a159bf20ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f675723ce844bf5ae965d0b53ae439d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:06 user nova-compute[75235]: INFO nova.compute.claims [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Claim successful on node user
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.165s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk 1073741824" returned: 0 in 0.053s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-changed-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Refreshing instance network info cache due to event network-changed-d3d47ecf-b064-4675-af30-06ec91e3f96d. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] Acquiring lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.069s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:06 user nova-compute[75235]: INFO nova.compute.claims [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Claim successful on node user
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Cannot resize image /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Ensure instance console log exists: /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.policy [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '556161926cf5420b82b6f33221ac8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049b77ff5714114a8808a39c57e1a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Creating image(s)
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:07 user nova-compute[75235]: INFO nova.compute.claims [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Claim successful on node user
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Creating image(s)
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.policy [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a8c2e833baa4dd9b5e747cb9b80d0d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff5711373c84c64ae6e6b37a2b6e6e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updating instance_info_cache with network_info: [{"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk 1073741824" returned: 0 in 0.056s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Releasing lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Instance network_info: |[{"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] Acquired lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Refreshing network info cache for port d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Start _get_guest_xml network_info=[{"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:07 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:07 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-573950174',display_name='tempest-DeleteServersTestJSON-server-573950174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-573950174',id=1,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9abbc576f624e2baa97407069b233b9',ramdisk_id='',reservation_id='r-i07ykxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-595916133',owner_user_name='tempest-DeleteServersTestJSON-595916133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:00Z,user_data=None,user_id='9bc8bd57cf474a43a211fd6f87188baa',uuid=151f125a-f385-48a6-8d2a-71312aa14ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Converting VIF {"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lazy-loading 'pci_devices' on Instance uuid 151f125a-f385-48a6-8d2a-71312aa14ed5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.200s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:07 user nova-compute[75235]:   <uuid>151f125a-f385-48a6-8d2a-71312aa14ed5</uuid>
Nov 29 19:01:07 user nova-compute[75235]:   <name>instance-00000001</name>
Nov 29 19:01:07 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:07 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:07 user nova-compute[75235]:   <metadata>
Nov 29 19:01:07 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:07 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:07 user nova-compute[75235]:       <nova:name>tempest-DeleteServersTestJSON-server-573950174</nova:name>
Nov 29 19:01:07 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:07</nova:creationTime>
Nov 29 19:01:07 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:07 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:07 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:07 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:user uuid="9bc8bd57cf474a43a211fd6f87188baa">tempest-DeleteServersTestJSON-595916133-project-member</nova:user>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:project uuid="c9abbc576f624e2baa97407069b233b9">tempest-DeleteServersTestJSON-595916133</nova:project>
Nov 29 19:01:07 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:07 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:07 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:07 user nova-compute[75235]:         <nova:port uuid="d3d47ecf-b064-4675-af30-06ec91e3f96d">
Nov 29 19:01:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 19:01:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:07 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:07 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:07 user nova-compute[75235]:   </metadata>
Nov 29 19:01:07 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:07 user nova-compute[75235]:     <system>
Nov 29 19:01:07 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:07 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:07 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:07 user nova-compute[75235]:       <entry name="serial">151f125a-f385-48a6-8d2a-71312aa14ed5</entry>
Nov 29 19:01:07 user nova-compute[75235]:       <entry name="uuid">151f125a-f385-48a6-8d2a-71312aa14ed5</entry>
Nov 29 19:01:07 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:07 user nova-compute[75235]:     </system>
Nov 29 19:01:07 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:07 user nova-compute[75235]:   <os>
Nov 29 19:01:07 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:07 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:07 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:07 user nova-compute[75235]:   </os>
Nov 29 19:01:07 user nova-compute[75235]:   <features>
Nov 29 19:01:07 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:07 user nova-compute[75235]:     <apic/>
Nov 29 19:01:07 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:07 user nova-compute[75235]:   </features>
Nov 29 19:01:07 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:07 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:07 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:07 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:07 user nova-compute[75235]:   </clock>
Nov 29 19:01:07 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:07 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:07 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:07 user nova-compute[75235]:   </cpu>
Nov 29 19:01:07 user nova-compute[75235]:   <devices>
Nov 29 19:01:07 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:07 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:07 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk"/>
Nov 29 19:01:07 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:07 user nova-compute[75235]:     </disk>
Nov 29 19:01:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:07 user nova-compute[75235]:       <mac address="fa:16:3e:68:af:5f"/>
Nov 29 19:01:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:07 user nova-compute[75235]:       <target dev="tapd3d47ecf-b0"/>
Nov 29 19:01:07 user nova-compute[75235]:     </interface>
Nov 29 19:01:07 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:07 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/console.log" append="off"/>
Nov 29 19:01:07 user nova-compute[75235]:     </serial>
Nov 29 19:01:07 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:07 user nova-compute[75235]:     <video>
Nov 29 19:01:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:07 user nova-compute[75235]:     </video>
Nov 29 19:01:07 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:07 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:07 user nova-compute[75235]:     </rng>
Nov 29 19:01:07 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:07 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:07 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:07 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:07 user nova-compute[75235]:   </devices>
Nov 29 19:01:07 user nova-compute[75235]: </domain>
Nov 29 19:01:07 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-573950174',display_name='tempest-DeleteServersTestJSON-server-573950174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-573950174',id=1,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9abbc576f624e2baa97407069b233b9',ramdisk_id='',reservation_id='r-i07ykxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-595916133',owner_user_name='tempest-DeleteServersTestJSON-595916133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:00Z,user_data=None,user_id='9bc8bd57cf474a43a211fd6f87188baa',uuid=151f125a-f385-48a6-8d2a-71312aa14ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Converting VIF {"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG os_vif [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Created schema index Interface.name {{(pid=75235) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Created schema index Port.name {{(pid=75235) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Created schema index Bridge.name {{(pid=75235) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.255s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [POLLOUT] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Cannot resize image /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Ensure instance console log exists: /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk 1073741824" returned: 0 in 0.109s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c894154-15c7-5585-a46b-3006657c0f99', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:08 user nova-compute[75235]: INFO oslo.privsep.daemon [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpj367gx77/privsep.sock']
Nov 29 19:01:08 user sudo[84556]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpj367gx77/privsep.sock
Nov 29 19:01:08 user sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Cannot resize image /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Ensure instance console log exists: /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Creating image(s)
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "/opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "/opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.154s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG nova.policy [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d98bb13233f447295cf54cb5b1574e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dafa45545c46169abd1cad11ba15cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk 1073741824" returned: 0 in 0.044s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Successfully created port: 62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Successfully created port: d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Cannot resize image /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Ensure instance console log exists: /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:09 user sudo[84556]: pam_unix(sudo:session): session closed for user root
Nov 29 19:01:09 user nova-compute[75235]: INFO oslo.privsep.daemon [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Spawned new privsep daemon via rootwrap
Nov 29 19:01:09 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 19:01:09 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 19:01:09 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 19:01:09 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84579
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updated VIF entry in instance network info cache for port d3d47ecf-b064-4675-af30-06ec91e3f96d. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updating instance_info_cache with network_info: [{"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-edef0593-3a1a-4efd-a4bf-9ad407f52db3 req-7986a794-64f0-4210-8b25-9dbc24657637 service nova] Releasing lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d47ecf-b0, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3d47ecf-b0, col_values=(('qos', UUID('64ff6e5e-78f5-4109-b9b7-7729ecb32169')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3d47ecf-b0, col_values=(('external_ids', {'iface-id': 'd3d47ecf-b064-4675-af30-06ec91e3f96d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:af:5f', 'vm-uuid': '151f125a-f385-48a6-8d2a-71312aa14ed5'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:10 user nova-compute[75235]: INFO os_vif [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0')
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] No VIF found with MAC fa:16:3e:68:af:5f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Successfully updated port: 62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Successfully created port: e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing instance network info cache due to event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Successfully updated port: d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquired lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-changed-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Refreshing instance network info cache due to event network-changed-d584745e-bfef-470a-8b88-a43e1f3d3f2b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] Acquiring lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Successfully created port: 28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance network_info: |[{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.neutron [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Start _get_guest_xml network_info=[{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:12 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:12 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1165392797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1165392797',id=3,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEII1tQquSsQcIVp/DbVQ39O0BcTO+EYsQFQm66AEFwNZL0nvH2fKVj0GY/eWa3Ziw3XMeigv16XYXD6yBlHC+b3T363mzu5UTvcexbwRIQkE+Uw1QKaYWWKiTeYDiqNiw==',key_name='tempest-keypair-1094556375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-e0vwlvoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=eafeb96d-7762-4d67-b3ff-e1221296ecb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.objects.instance [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'pci_devices' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:12 user nova-compute[75235]:   <uuid>eafeb96d-7762-4d67-b3ff-e1221296ecb5</uuid>
Nov 29 19:01:12 user nova-compute[75235]:   <name>instance-00000003</name>
Nov 29 19:01:12 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:12 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:12 user nova-compute[75235]:   <metadata>
Nov 29 19:01:12 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:12 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:12 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1165392797</nova:name>
Nov 29 19:01:12 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:12</nova:creationTime>
Nov 29 19:01:12 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:12 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:12 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:12 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:user uuid="556161926cf5420b82b6f33221ac8fb4">tempest-AttachVolumeShelveTestJSON-850280898-project-member</nova:user>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:project uuid="f049b77ff5714114a8808a39c57e1a94">tempest-AttachVolumeShelveTestJSON-850280898</nova:project>
Nov 29 19:01:12 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:12 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:12 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:12 user nova-compute[75235]:         <nova:port uuid="62fcb2af-3273-4fdc-b68a-6c0492925844">
Nov 29 19:01:12 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 19:01:12 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:12 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:12 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:12 user nova-compute[75235]:   </metadata>
Nov 29 19:01:12 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:12 user nova-compute[75235]:     <system>
Nov 29 19:01:12 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:12 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:12 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:12 user nova-compute[75235]:       <entry name="serial">eafeb96d-7762-4d67-b3ff-e1221296ecb5</entry>
Nov 29 19:01:12 user nova-compute[75235]:       <entry name="uuid">eafeb96d-7762-4d67-b3ff-e1221296ecb5</entry>
Nov 29 19:01:12 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:12 user nova-compute[75235]:     </system>
Nov 29 19:01:12 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:12 user nova-compute[75235]:   <os>
Nov 29 19:01:12 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:12 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:12 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:12 user nova-compute[75235]:   </os>
Nov 29 19:01:12 user nova-compute[75235]:   <features>
Nov 29 19:01:12 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:12 user nova-compute[75235]:     <apic/>
Nov 29 19:01:12 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:12 user nova-compute[75235]:   </features>
Nov 29 19:01:12 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:12 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:12 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:12 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:12 user nova-compute[75235]:   </clock>
Nov 29 19:01:12 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:12 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:12 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:12 user nova-compute[75235]:   </cpu>
Nov 29 19:01:12 user nova-compute[75235]:   <devices>
Nov 29 19:01:12 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:12 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:12 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk"/>
Nov 29 19:01:12 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:12 user nova-compute[75235]:     </disk>
Nov 29 19:01:12 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:12 user nova-compute[75235]:       <mac address="fa:16:3e:1f:30:a0"/>
Nov 29 19:01:12 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:12 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:12 user nova-compute[75235]:       <target dev="tap62fcb2af-32"/>
Nov 29 19:01:12 user nova-compute[75235]:     </interface>
Nov 29 19:01:12 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:12 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/console.log" append="off"/>
Nov 29 19:01:12 user nova-compute[75235]:     </serial>
Nov 29 19:01:12 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:12 user nova-compute[75235]:     <video>
Nov 29 19:01:12 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:12 user nova-compute[75235]:     </video>
Nov 29 19:01:12 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:12 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:12 user nova-compute[75235]:     </rng>
Nov 29 19:01:12 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:12 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:12 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:12 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:12 user nova-compute[75235]:   </devices>
Nov 29 19:01:12 user nova-compute[75235]: </domain>
Nov 29 19:01:12 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1165392797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1165392797',id=3,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEII1tQquSsQcIVp/DbVQ39O0BcTO+EYsQFQm66AEFwNZL0nvH2fKVj0GY/eWa3Ziw3XMeigv16XYXD6yBlHC+b3T363mzu5UTvcexbwRIQkE+Uw1QKaYWWKiTeYDiqNiw==',key_name='tempest-keypair-1094556375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-e0vwlvoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=eafeb96d-7762-4d67-b3ff-e1221296ecb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG os_vif [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '356730ff-14cd-5570-bcaa-14ee17a3cbc6', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62fcb2af-32, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62fcb2af-32, col_values=(('qos', UUID('6baadef8-48ca-452c-b551-773f19a94373')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62fcb2af-32, col_values=(('external_ids', {'iface-id': '62fcb2af-3273-4fdc-b68a-6c0492925844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:30:a0', 'vm-uuid': 'eafeb96d-7762-4d67-b3ff-e1221296ecb5'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:12 user nova-compute[75235]: INFO os_vif [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32')
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No VIF found with MAC fa:16:3e:1f:30:a0, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Instance spawned successfully.
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:13 user nova-compute[75235]: INFO nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Took 12.85 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:13 user nova-compute[75235]: INFO nova.compute.manager [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Took 13.78 seconds to build instance.
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating instance_info_cache with network_info: [{"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e1f2cfb4-c1ef-4fa6-8139-5c4210f22913 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.124s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Releasing lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Instance network_info: |[{"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] Acquired lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.network.neutron [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Refreshing network info cache for port d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Start _get_guest_xml network_info=[{"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:13 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:13 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2004234973',display_name='tempest-AttachVolumeTestJSON-server-2004234973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2004234973',id=2,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmUpOJrJWlPMvnNzLYyWWwSlNtxXqeK5V+hnbPZK2L89PubR9MExqLj0fZnBLGLlP/YVa7e2/OpEoyimOMmHLLvvea/oslu7wRjgyoe9YoyRqApOc2qlktow2iDCyt2cw==',key_name='tempest-keypair-508237282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f675723ce844bf5ae965d0b53ae439d',ramdisk_id='',reservation_id='r-cho0j1i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430085223',owner_user_name='tempest-AttachVolumeTestJSON-1430085223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2babb226c484046aab50a159bf20ef4',uuid=aa2da6c4-f2d2-4598-9113-122b3ca34133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converting VIF {"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.objects.instance [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'pci_devices' on Instance uuid aa2da6c4-f2d2-4598-9113-122b3ca34133 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:13 user nova-compute[75235]:   <uuid>aa2da6c4-f2d2-4598-9113-122b3ca34133</uuid>
Nov 29 19:01:13 user nova-compute[75235]:   <name>instance-00000002</name>
Nov 29 19:01:13 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:13 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:13 user nova-compute[75235]:   <metadata>
Nov 29 19:01:13 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:13 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:13 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeTestJSON-server-2004234973</nova:name>
Nov 29 19:01:13 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:13</nova:creationTime>
Nov 29 19:01:13 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:13 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:13 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:13 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:user uuid="e2babb226c484046aab50a159bf20ef4">tempest-AttachVolumeTestJSON-1430085223-project-member</nova:user>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:project uuid="9f675723ce844bf5ae965d0b53ae439d">tempest-AttachVolumeTestJSON-1430085223</nova:project>
Nov 29 19:01:13 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:13 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:13 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:13 user nova-compute[75235]:         <nova:port uuid="d584745e-bfef-470a-8b88-a43e1f3d3f2b">
Nov 29 19:01:13 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:01:13 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:13 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:13 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:13 user nova-compute[75235]:   </metadata>
Nov 29 19:01:13 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:13 user nova-compute[75235]:     <system>
Nov 29 19:01:13 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:13 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:13 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:13 user nova-compute[75235]:       <entry name="serial">aa2da6c4-f2d2-4598-9113-122b3ca34133</entry>
Nov 29 19:01:13 user nova-compute[75235]:       <entry name="uuid">aa2da6c4-f2d2-4598-9113-122b3ca34133</entry>
Nov 29 19:01:13 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:13 user nova-compute[75235]:     </system>
Nov 29 19:01:13 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:13 user nova-compute[75235]:   <os>
Nov 29 19:01:13 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:13 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:13 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:13 user nova-compute[75235]:   </os>
Nov 29 19:01:13 user nova-compute[75235]:   <features>
Nov 29 19:01:13 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:13 user nova-compute[75235]:     <apic/>
Nov 29 19:01:13 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:13 user nova-compute[75235]:   </features>
Nov 29 19:01:13 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:13 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:13 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:13 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:13 user nova-compute[75235]:   </clock>
Nov 29 19:01:13 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:13 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:13 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:13 user nova-compute[75235]:   </cpu>
Nov 29 19:01:13 user nova-compute[75235]:   <devices>
Nov 29 19:01:13 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:13 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:13 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk"/>
Nov 29 19:01:13 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:13 user nova-compute[75235]:     </disk>
Nov 29 19:01:13 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:13 user nova-compute[75235]:       <mac address="fa:16:3e:9f:b0:eb"/>
Nov 29 19:01:13 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:13 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:13 user nova-compute[75235]:       <target dev="tapd584745e-bf"/>
Nov 29 19:01:13 user nova-compute[75235]:     </interface>
Nov 29 19:01:13 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:13 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/console.log" append="off"/>
Nov 29 19:01:13 user nova-compute[75235]:     </serial>
Nov 29 19:01:13 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:13 user nova-compute[75235]:     <video>
Nov 29 19:01:13 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:13 user nova-compute[75235]:     </video>
Nov 29 19:01:13 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:13 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:13 user nova-compute[75235]:     </rng>
Nov 29 19:01:13 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:13 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:13 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:13 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:13 user nova-compute[75235]:   </devices>
Nov 29 19:01:13 user nova-compute[75235]: </domain>
Nov 29 19:01:13 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2004234973',display_name='tempest-AttachVolumeTestJSON-server-2004234973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2004234973',id=2,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmUpOJrJWlPMvnNzLYyWWwSlNtxXqeK5V+hnbPZK2L89PubR9MExqLj0fZnBLGLlP/YVa7e2/OpEoyimOMmHLLvvea/oslu7wRjgyoe9YoyRqApOc2qlktow2iDCyt2cw==',key_name='tempest-keypair-508237282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f675723ce844bf5ae965d0b53ae439d',ramdisk_id='',reservation_id='r-cho0j1i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430085223',owner_user_name='tempest-AttachVolumeTestJSON-1430085223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2babb226c484046aab50a159bf20ef4',uuid=aa2da6c4-f2d2-4598-9113-122b3ca34133,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converting VIF {"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG os_vif [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f0e0b3a-d50b-5d0e-a7c9-01e44fa1314c', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd584745e-bf, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd584745e-bf, col_values=(('qos', UUID('6ef49749-e99a-4ae0-80ec-fd60ebfa8840')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd584745e-bf, col_values=(('external_ids', {'iface-id': 'd584745e-bfef-470a-8b88-a43e1f3d3f2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:b0:eb', 'vm-uuid': 'aa2da6c4-f2d2-4598-9113-122b3ca34133'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:13 user nova-compute[75235]: INFO os_vif [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf')
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No VIF found with MAC fa:16:3e:9f:b0:eb, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updated VIF entry in instance network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d07c1dd4-0556-40f6-a2ad-22c82a4dca29 req-8ba6be73-7160-46a0-bbc4-29dc4deb7d1c service nova] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updated VIF entry in instance network info cache for port d584745e-bfef-470a-8b88-a43e1f3d3f2b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating instance_info_cache with network_info: [{"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a61b6f1c-d8b9-4945-8259-8208b1b0d90f req-3a814dfa-53e8-4413-a7ae-1615be5c18cb service nova] Releasing lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Successfully updated port: e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing instance network info cache due to event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Successfully updated port: 28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance network_info: |[{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Start _get_guest_xml network_info=[{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-710912652',display_name='tempest-ServerStableDeviceRescueTest-server-710912652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-710912652',id=4,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEE4xxI+rQAyw/TzS9A4k6eJoe1wHbvSnlCb5Nulp5mkRRugqtYAQDnxmY/dTLGRZaveb1cl3jcqZZS93b/kPlX06OJHF035hxQSxdyQNHDmeTHLtUvPxUQmDXyo+SK9A==',key_name='tempest-keypair-2119009507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff5711373c84c64ae6e6b37a2b6e6e7',ramdisk_id='',reservation_id='r-0mqvpcox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2102571705',owner_user_name='tempest-ServerStableDeviceRescueTest-2102571705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a8c2e833baa4dd9b5e747cb9b80d0d8',uuid=9e3e385e-b3ea-4dae-923c-eddacb2a42d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converting VIF {"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:16 user nova-compute[75235]:   <uuid>9e3e385e-b3ea-4dae-923c-eddacb2a42d7</uuid>
Nov 29 19:01:16 user nova-compute[75235]:   <name>instance-00000004</name>
Nov 29 19:01:16 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:16 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:16 user nova-compute[75235]:   <metadata>
Nov 29 19:01:16 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:16 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:16 user nova-compute[75235]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-710912652</nova:name>
Nov 29 19:01:16 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:16</nova:creationTime>
Nov 29 19:01:16 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:16 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:16 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:16 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:user uuid="3a8c2e833baa4dd9b5e747cb9b80d0d8">tempest-ServerStableDeviceRescueTest-2102571705-project-member</nova:user>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:project uuid="2ff5711373c84c64ae6e6b37a2b6e6e7">tempest-ServerStableDeviceRescueTest-2102571705</nova:project>
Nov 29 19:01:16 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:16 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:16 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:16 user nova-compute[75235]:         <nova:port uuid="e3569ef3-c352-424a-8e4a-2be65c7de3a5">
Nov 29 19:01:16 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:01:16 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:16 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:16 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:16 user nova-compute[75235]:   </metadata>
Nov 29 19:01:16 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:16 user nova-compute[75235]:     <system>
Nov 29 19:01:16 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:16 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:16 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:16 user nova-compute[75235]:       <entry name="serial">9e3e385e-b3ea-4dae-923c-eddacb2a42d7</entry>
Nov 29 19:01:16 user nova-compute[75235]:       <entry name="uuid">9e3e385e-b3ea-4dae-923c-eddacb2a42d7</entry>
Nov 29 19:01:16 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:16 user nova-compute[75235]:     </system>
Nov 29 19:01:16 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:16 user nova-compute[75235]:   <os>
Nov 29 19:01:16 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:16 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:16 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:16 user nova-compute[75235]:   </os>
Nov 29 19:01:16 user nova-compute[75235]:   <features>
Nov 29 19:01:16 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:16 user nova-compute[75235]:     <apic/>
Nov 29 19:01:16 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:16 user nova-compute[75235]:   </features>
Nov 29 19:01:16 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:16 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:16 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:16 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:16 user nova-compute[75235]:   </clock>
Nov 29 19:01:16 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:16 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:16 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:16 user nova-compute[75235]:   </cpu>
Nov 29 19:01:16 user nova-compute[75235]:   <devices>
Nov 29 19:01:16 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:16 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:16 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk"/>
Nov 29 19:01:16 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:16 user nova-compute[75235]:     </disk>
Nov 29 19:01:16 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:16 user nova-compute[75235]:       <mac address="fa:16:3e:fe:ec:c3"/>
Nov 29 19:01:16 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:16 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:16 user nova-compute[75235]:       <target dev="tape3569ef3-c3"/>
Nov 29 19:01:16 user nova-compute[75235]:     </interface>
Nov 29 19:01:16 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:16 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/console.log" append="off"/>
Nov 29 19:01:16 user nova-compute[75235]:     </serial>
Nov 29 19:01:16 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:16 user nova-compute[75235]:     <video>
Nov 29 19:01:16 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:16 user nova-compute[75235]:     </video>
Nov 29 19:01:16 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:16 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:16 user nova-compute[75235]:     </rng>
Nov 29 19:01:16 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:16 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:16 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:16 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:16 user nova-compute[75235]:   </devices>
Nov 29 19:01:16 user nova-compute[75235]: </domain>
Nov 29 19:01:16 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-710912652',display_name='tempest-ServerStableDeviceRescueTest-server-710912652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-710912652',id=4,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEE4xxI+rQAyw/TzS9A4k6eJoe1wHbvSnlCb5Nulp5mkRRugqtYAQDnxmY/dTLGRZaveb1cl3jcqZZS93b/kPlX06OJHF035hxQSxdyQNHDmeTHLtUvPxUQmDXyo+SK9A==',key_name='tempest-keypair-2119009507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff5711373c84c64ae6e6b37a2b6e6e7',ramdisk_id='',reservation_id='r-0mqvpcox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2102571705',owner_user_name='tempest-ServerStableDeviceRescueTest-2102571705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a8c2e833baa4dd9b5e747cb9b80d0d8',uuid=9e3e385e-b3ea-4dae-923c-eddacb2a42d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converting VIF {"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG os_vif [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd175724d-a5f9-5dc3-b2e3-d37588f52920', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3569ef3-c3, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3569ef3-c3, col_values=(('qos', UUID('f50aed40-79eb-4b93-a129-a15c8aaa9ef6')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3569ef3-c3, col_values=(('external_ids', {'iface-id': 'e3569ef3-c352-424a-8e4a-2be65c7de3a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ec:c3', 'vm-uuid': '9e3e385e-b3ea-4dae-923c-eddacb2a42d7'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:16 user nova-compute[75235]: INFO os_vif [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3')
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No VIF found with MAC fa:16:3e:fe:ec:c3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-changed-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Refreshing instance network info cache due to event network-changed-28cea0d8-5bab-4184-ad2f-5e9bc62110db. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG nova.network.neutron [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Instance network_info: |[{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG nova.network.neutron [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Refreshing network info cache for port 28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Start _get_guest_xml network_info=[{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:18 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:18 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1075362989',display_name='tempest-ServerActionsTestOtherA-server-1075362989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1075362989',id=5,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-ng2kh00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=c1d8be89-d905-43dc-8d73-4632fa1e7227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.objects.instance [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'pci_devices' on Instance uuid c1d8be89-d905-43dc-8d73-4632fa1e7227 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:18 user nova-compute[75235]:   <uuid>c1d8be89-d905-43dc-8d73-4632fa1e7227</uuid>
Nov 29 19:01:18 user nova-compute[75235]:   <name>instance-00000005</name>
Nov 29 19:01:18 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:18 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:18 user nova-compute[75235]:   <metadata>
Nov 29 19:01:18 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:18 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:18 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherA-server-1075362989</nova:name>
Nov 29 19:01:18 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:18</nova:creationTime>
Nov 29 19:01:18 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:18 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:18 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:18 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:user uuid="1d98bb13233f447295cf54cb5b1574e8">tempest-ServerActionsTestOtherA-279549641-project-member</nova:user>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:project uuid="68dafa45545c46169abd1cad11ba15cc">tempest-ServerActionsTestOtherA-279549641</nova:project>
Nov 29 19:01:18 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:18 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:18 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:18 user nova-compute[75235]:         <nova:port uuid="28cea0d8-5bab-4184-ad2f-5e9bc62110db">
Nov 29 19:01:18 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:01:18 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:18 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:18 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:18 user nova-compute[75235]:   </metadata>
Nov 29 19:01:18 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:18 user nova-compute[75235]:     <system>
Nov 29 19:01:18 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:18 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:18 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:18 user nova-compute[75235]:       <entry name="serial">c1d8be89-d905-43dc-8d73-4632fa1e7227</entry>
Nov 29 19:01:18 user nova-compute[75235]:       <entry name="uuid">c1d8be89-d905-43dc-8d73-4632fa1e7227</entry>
Nov 29 19:01:18 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:18 user nova-compute[75235]:     </system>
Nov 29 19:01:18 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:18 user nova-compute[75235]:   <os>
Nov 29 19:01:18 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:18 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:18 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:18 user nova-compute[75235]:   </os>
Nov 29 19:01:18 user nova-compute[75235]:   <features>
Nov 29 19:01:18 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:18 user nova-compute[75235]:     <apic/>
Nov 29 19:01:18 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:18 user nova-compute[75235]:   </features>
Nov 29 19:01:18 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:18 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:18 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:18 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:18 user nova-compute[75235]:   </clock>
Nov 29 19:01:18 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:18 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:18 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:18 user nova-compute[75235]:   </cpu>
Nov 29 19:01:18 user nova-compute[75235]:   <devices>
Nov 29 19:01:18 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:18 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:18 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk"/>
Nov 29 19:01:18 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:18 user nova-compute[75235]:     </disk>
Nov 29 19:01:18 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:18 user nova-compute[75235]:       <mac address="fa:16:3e:26:f0:81"/>
Nov 29 19:01:18 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:18 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:18 user nova-compute[75235]:       <target dev="tap28cea0d8-5b"/>
Nov 29 19:01:18 user nova-compute[75235]:     </interface>
Nov 29 19:01:18 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:18 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/console.log" append="off"/>
Nov 29 19:01:18 user nova-compute[75235]:     </serial>
Nov 29 19:01:18 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:18 user nova-compute[75235]:     <video>
Nov 29 19:01:18 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:18 user nova-compute[75235]:     </video>
Nov 29 19:01:18 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:18 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:18 user nova-compute[75235]:     </rng>
Nov 29 19:01:18 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:18 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:18 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:18 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:18 user nova-compute[75235]:   </devices>
Nov 29 19:01:18 user nova-compute[75235]: </domain>
Nov 29 19:01:18 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1075362989',display_name='tempest-ServerActionsTestOtherA-server-1075362989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1075362989',id=5,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-ng2kh00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=c1d8be89-d905-43dc-8d73-4632fa1e7227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG os_vif [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c266e8c-cec9-5f3f-bf6a-ef72b54a5f0e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28cea0d8-5b, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28cea0d8-5b, col_values=(('qos', UUID('b7ac3cbd-43b1-46a2-9547-d07e5378be3c')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28cea0d8-5b, col_values=(('external_ids', {'iface-id': '28cea0d8-5bab-4184-ad2f-5e9bc62110db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:f0:81', 'vm-uuid': 'c1d8be89-d905-43dc-8d73-4632fa1e7227'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: INFO os_vif [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b')
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No VIF found with MAC fa:16:3e:26:f0:81, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance spawned successfully.
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.network.neutron [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updated VIF entry in instance network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.network.neutron [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Instance spawned successfully.
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-81fb5b65-1322-45c8-bd09-379a25fe6925 req-b6e41f0d-7370-4e05-86fd-5b88f66911d6 service nova] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:18 user nova-compute[75235]: INFO nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Took 11.46 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:18 user nova-compute[75235]: INFO nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Took 12.52 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:18 user nova-compute[75235]: INFO nova.compute.manager [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Took 12.37 seconds to build instance.
Nov 29 19:01:18 user nova-compute[75235]: INFO nova.compute.manager [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Took 13.34 seconds to build instance.
Nov 29 19:01:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-639f0148-e3f0-4692-8bf4-5cae2a794210 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.467s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48c9cd8e-d922-4084-a4bb-21e1f7974f58 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.553s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updated VIF entry in instance network info cache for port 28cea0d8-5bab-4184-ad2f-5e9bc62110db. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-28e6c557-39cd-43c8-a6d8-d34603c2cf58 req-86894ffe-13a6-421a-9523-0e78b2e5d436 service nova] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:22 user nova-compute[75235]: INFO nova.compute.claims [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Claim successful on node user
Nov 29 19:01:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.policy [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f516b841e854f1dbc8518c1e346fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbea24130784a9fbd5a9572e30b3094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Creating image(s)
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "/opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "/opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "/opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance spawned successfully.
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.430s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:23 user nova-compute[75235]: INFO nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Took 16.33 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Instance spawned successfully.
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.406s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:24 user nova-compute[75235]: INFO nova.compute.manager [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Took 17.44 seconds to build instance.
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk 1073741824" returned: 0 in 0.105s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.523s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c20ab37f-0d9a-44e8-9e3d-9b71c1474bff tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.698s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:24 user nova-compute[75235]: INFO nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Took 15.86 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:24 user nova-compute[75235]: INFO nova.compute.manager [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Took 17.30 seconds to build instance.
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.385s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-422bbf73-9e4d-44f1-85e0-f7052476e285 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.525s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.360s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Cannot resize image /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Ensure instance console log exists: /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Successfully created port: e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:25 user nova-compute[75235]: INFO nova.compute.claims [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Claim successful on node user
Nov 29 19:01:25 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-cd91d6d5-06a6-40f3-bd92-c43c9a3288ce req-915dc56f-d3e7-4760-b0ee-b5f6be55015c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cd91d6d5-06a6-40f3-bd92-c43c9a3288ce req-915dc56f-d3e7-4760-b0ee-b5f6be55015c service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cd91d6d5-06a6-40f3-bd92-c43c9a3288ce req-915dc56f-d3e7-4760-b0ee-b5f6be55015c service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cd91d6d5-06a6-40f3-bd92-c43c9a3288ce req-915dc56f-d3e7-4760-b0ee-b5f6be55015c service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-cd91d6d5-06a6-40f3-bd92-c43c9a3288ce req-915dc56f-d3e7-4760-b0ee-b5f6be55015c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:26 user nova-compute[75235]: WARNING nova.compute.manager [req-cd91d6d5-06a6-40f3-bd92-c43c9a3288ce req-915dc56f-d3e7-4760-b0ee-b5f6be55015c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state None.
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.912s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.network.neutron [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Creating image(s)
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG nova.policy [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18f21971b2c04c03922cca2bd064cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749fed6b75994169b86c6e7cf2fe8603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.298s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.279s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk 1073741824" returned: 0 in 0.076s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.266s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Cannot resize image /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Ensure instance console log exists: /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.network.neutron [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Successfully updated port: e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquired lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.network.neutron [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:28 user nova-compute[75235]: WARNING nova.compute.manager [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state None.
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-changed-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Refreshing instance network info cache due to event network-changed-e3bc0bbb-19b7-481d-a207-158aa7d7fe78. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] Acquiring lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG nova.network.neutron [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.neutron [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Successfully created port: 5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.neutron [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating instance_info_cache with network_info: [{"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Releasing lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Instance network_info: |[{"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] Acquired lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.neutron [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Refreshing network info cache for port e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Start _get_guest_xml network_info=[{"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:29 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:29 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1644296104',display_name='tempest-VolumesAdminNegativeTest-server-1644296104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1644296104',id=6,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCO8g8+z+yWFbZ1RW/mxkXE19r6HX5CzQvcqt8ZRx9CULEgaIj409V77QwiLUkmVJSt6/OYwoSNkd2X00no2L6tCes4WM+JU97QfT4puDc8dyERiqX1xr8XCig4OQCSxA==',key_name='tempest-keypair-158564876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbbea24130784a9fbd5a9572e30b3094',ramdisk_id='',reservation_id='r-lrw9gifa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1338291818',owner_user_name='tempest-VolumesAdminNegativeTest-1338291818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f516b841e854f1dbc8518c1e346fb0d',uuid=d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converting VIF {"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.objects.instance [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'pci_devices' on Instance uuid d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:29 user nova-compute[75235]:   <uuid>d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2</uuid>
Nov 29 19:01:29 user nova-compute[75235]:   <name>instance-00000006</name>
Nov 29 19:01:29 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:29 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:29 user nova-compute[75235]:   <metadata>
Nov 29 19:01:29 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:29 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:29 user nova-compute[75235]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1644296104</nova:name>
Nov 29 19:01:29 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:29</nova:creationTime>
Nov 29 19:01:29 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:29 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:29 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:29 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:user uuid="8f516b841e854f1dbc8518c1e346fb0d">tempest-VolumesAdminNegativeTest-1338291818-project-member</nova:user>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:project uuid="cbbea24130784a9fbd5a9572e30b3094">tempest-VolumesAdminNegativeTest-1338291818</nova:project>
Nov 29 19:01:29 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:29 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:29 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:29 user nova-compute[75235]:         <nova:port uuid="e3bc0bbb-19b7-481d-a207-158aa7d7fe78">
Nov 29 19:01:29 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:01:29 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:29 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:29 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:29 user nova-compute[75235]:   </metadata>
Nov 29 19:01:29 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:29 user nova-compute[75235]:     <system>
Nov 29 19:01:29 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:29 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:29 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:29 user nova-compute[75235]:       <entry name="serial">d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2</entry>
Nov 29 19:01:29 user nova-compute[75235]:       <entry name="uuid">d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2</entry>
Nov 29 19:01:29 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:29 user nova-compute[75235]:     </system>
Nov 29 19:01:29 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:29 user nova-compute[75235]:   <os>
Nov 29 19:01:29 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:29 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:29 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:29 user nova-compute[75235]:   </os>
Nov 29 19:01:29 user nova-compute[75235]:   <features>
Nov 29 19:01:29 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:29 user nova-compute[75235]:     <apic/>
Nov 29 19:01:29 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:29 user nova-compute[75235]:   </features>
Nov 29 19:01:29 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:29 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:29 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:29 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:29 user nova-compute[75235]:   </clock>
Nov 29 19:01:29 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:29 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:29 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:29 user nova-compute[75235]:   </cpu>
Nov 29 19:01:29 user nova-compute[75235]:   <devices>
Nov 29 19:01:29 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:29 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:29 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk"/>
Nov 29 19:01:29 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:29 user nova-compute[75235]:     </disk>
Nov 29 19:01:29 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:29 user nova-compute[75235]:       <mac address="fa:16:3e:c1:e1:90"/>
Nov 29 19:01:29 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:29 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:29 user nova-compute[75235]:       <target dev="tape3bc0bbb-19"/>
Nov 29 19:01:29 user nova-compute[75235]:     </interface>
Nov 29 19:01:29 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:29 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/console.log" append="off"/>
Nov 29 19:01:29 user nova-compute[75235]:     </serial>
Nov 29 19:01:29 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:29 user nova-compute[75235]:     <video>
Nov 29 19:01:29 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:29 user nova-compute[75235]:     </video>
Nov 29 19:01:29 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:29 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:29 user nova-compute[75235]:     </rng>
Nov 29 19:01:29 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:29 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:29 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:29 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:29 user nova-compute[75235]:   </devices>
Nov 29 19:01:29 user nova-compute[75235]: </domain>
Nov 29 19:01:29 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1644296104',display_name='tempest-VolumesAdminNegativeTest-server-1644296104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1644296104',id=6,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCO8g8+z+yWFbZ1RW/mxkXE19r6HX5CzQvcqt8ZRx9CULEgaIj409V77QwiLUkmVJSt6/OYwoSNkd2X00no2L6tCes4WM+JU97QfT4puDc8dyERiqX1xr8XCig4OQCSxA==',key_name='tempest-keypair-158564876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbbea24130784a9fbd5a9572e30b3094',ramdisk_id='',reservation_id='r-lrw9gifa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1338291818',owner_user_name='tempest-VolumesAdminNegativeTest-1338291818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f516b841e854f1dbc8518c1e346fb0d',uuid=d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converting VIF {"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG os_vif [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dce1596-743d-556d-8fdf-f7fb8a90274e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3bc0bbb-19, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3bc0bbb-19, col_values=(('qos', UUID('91c95d4d-167a-4742-81b2-96aa7535097a')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3bc0bbb-19, col_values=(('external_ids', {'iface-id': 'e3bc0bbb-19b7-481d-a207-158aa7d7fe78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:e1:90', 'vm-uuid': 'd588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:29 user nova-compute[75235]: INFO os_vif [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19')
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No VIF found with MAC fa:16:3e:c1:e1:90, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:30 user nova-compute[75235]: INFO nova.compute.claims [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Claim successful on node user
Nov 29 19:01:30 user nova-compute[75235]: DEBUG nova.network.neutron [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updated VIF entry in instance network info cache for port e3bc0bbb-19b7-481d-a207-158aa7d7fe78. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG nova.network.neutron [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating instance_info_cache with network_info: [{"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0f5674fe-457b-4ea2-9855-72b4917dabdb req-e09aed7c-f944-4651-b16f-6418d7b7633e service nova] Releasing lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Successfully updated port: 5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.policy [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1e5eb354d2a4fde953ac63aa8573d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46132496c2942c7bbe25a049fa21b4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquired lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-changed-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Refreshing instance network info cache due to event network-changed-5b1fd2ee-3e0c-4951-8909-25b853d04b1c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] Acquiring lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Creating image(s)
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "/opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "/opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "/opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "d32a0bb2c868e7899e4205167ff4dee6b2bfe519" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "d32a0bb2c868e7899e4205167ff4dee6b2bfe519" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-8eff0934-798b-42b2-83fa-fa8fa42d250b req-17030d68-b74f-4693-9827-8bf8852e23a3 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8eff0934-798b-42b2-83fa-fa8fa42d250b req-17030d68-b74f-4693-9827-8bf8852e23a3 service nova] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8eff0934-798b-42b2-83fa-fa8fa42d250b req-17030d68-b74f-4693-9827-8bf8852e23a3 service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8eff0934-798b-42b2-83fa-fa8fa42d250b req-17030d68-b74f-4693-9827-8bf8852e23a3 service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-8eff0934-798b-42b2-83fa-fa8fa42d250b req-17030d68-b74f-4693-9827-8bf8852e23a3 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] No waiting events found dispatching network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:31 user nova-compute[75235]: WARNING nova.compute.manager [req-8eff0934-798b-42b2-83fa-fa8fa42d250b req-17030d68-b74f-4693-9827-8bf8852e23a3 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received unexpected event network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d for instance with vm_state active and task_state None.
Nov 29 19:01:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.part --force-share --output=json" returned: 0 in 0.394s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG nova.virt.images [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] 31e26ebd-cc92-4474-aace-2d4d393bcc89 was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:01:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.part /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.neutron [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.part /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.converted" returned: 0 in 0.487s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Releasing lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Instance network_info: |[{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] Acquired lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Refreshing network info cache for port 5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Start _get_guest_xml network_info=[{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.objects.instance [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'pci_devices' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.neutron [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Successfully created port: 9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "d32a0bb2c868e7899e4205167ff4dee6b2bfe519" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.030s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:33 user nova-compute[75235]:   <uuid>d7e65309-b31e-4e11-bc9c-495c13d276bf</uuid>
Nov 29 19:01:33 user nova-compute[75235]:   <name>instance-00000007</name>
Nov 29 19:01:33 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:33 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:33 user nova-compute[75235]:   <metadata>
Nov 29 19:01:33 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:33 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:33 user nova-compute[75235]:       <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:01:33 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:33</nova:creationTime>
Nov 29 19:01:33 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:33 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:33 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:33 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:01:33 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:33 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:33 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:33 user nova-compute[75235]:         <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:01:33 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:01:33 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:33 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:33 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:33 user nova-compute[75235]:   </metadata>
Nov 29 19:01:33 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:33 user nova-compute[75235]:     <system>
Nov 29 19:01:33 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:33 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:33 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:33 user nova-compute[75235]:       <entry name="serial">d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:01:33 user nova-compute[75235]:       <entry name="uuid">d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:01:33 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:33 user nova-compute[75235]:     </system>
Nov 29 19:01:33 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:33 user nova-compute[75235]:   <os>
Nov 29 19:01:33 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:33 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:33 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:33 user nova-compute[75235]:   </os>
Nov 29 19:01:33 user nova-compute[75235]:   <features>
Nov 29 19:01:33 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:33 user nova-compute[75235]:     <apic/>
Nov 29 19:01:33 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:33 user nova-compute[75235]:   </features>
Nov 29 19:01:33 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:33 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:33 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:33 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:33 user nova-compute[75235]:   </clock>
Nov 29 19:01:33 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:33 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:33 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:33 user nova-compute[75235]:   </cpu>
Nov 29 19:01:33 user nova-compute[75235]:   <devices>
Nov 29 19:01:33 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:33 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:33 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk"/>
Nov 29 19:01:33 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:33 user nova-compute[75235]:     </disk>
Nov 29 19:01:33 user nova-compute[75235]:     <disk type="file" device="cdrom">
Nov 29 19:01:33 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 19:01:33 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config"/>
Nov 29 19:01:33 user nova-compute[75235]:       <target dev="hda" bus="ide"/>
Nov 29 19:01:33 user nova-compute[75235]:     </disk>
Nov 29 19:01:33 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:33 user nova-compute[75235]:       <mac address="fa:16:3e:5d:6c:67"/>
Nov 29 19:01:33 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:33 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:33 user nova-compute[75235]:       <target dev="tap5b1fd2ee-3e"/>
Nov 29 19:01:33 user nova-compute[75235]:     </interface>
Nov 29 19:01:33 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:33 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log" append="off"/>
Nov 29 19:01:33 user nova-compute[75235]:     </serial>
Nov 29 19:01:33 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:33 user nova-compute[75235]:     <video>
Nov 29 19:01:33 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:33 user nova-compute[75235]:     </video>
Nov 29 19:01:33 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:33 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:33 user nova-compute[75235]:     </rng>
Nov 29 19:01:33 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:33 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:33 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:33 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:33 user nova-compute[75235]:   </devices>
Nov 29 19:01:33 user nova-compute[75235]: </domain>
Nov 29 19:01:33 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG os_vif [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9914fbe2-2352-527c-9947-d74d9075fa6f', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b1fd2ee-3e, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b1fd2ee-3e, col_values=(('qos', UUID('36f1f3af-be40-4f83-b7b4-319400ac0c67')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b1fd2ee-3e, col_values=(('external_ids', {'iface-id': '5b1fd2ee-3e0c-4951-8909-25b853d04b1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:6c:67', 'vm-uuid': 'd7e65309-b31e-4e11-bc9c-495c13d276bf'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:33 user nova-compute[75235]: INFO os_vif [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e')
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No BDM found with device name hda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No VIF found with MAC fa:16:3e:5d:6c:67, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:33 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Using config drive
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] No waiting events found dispatching network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received unexpected event network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d for instance with vm_state active and task_state None.
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] No waiting events found dispatching network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received unexpected event network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b for instance with vm_state active and task_state None.
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] No waiting events found dispatching network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received unexpected event network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b for instance with vm_state active and task_state None.
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state active and task_state None.
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:33 user nova-compute[75235]: WARNING nova.compute.manager [req-43de7db7-2e56-4c12-bcce-d7d452c23be9 req-b70d30aa-220f-4d54-a1cb-3be75cbab3fd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state active and task_state None.
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519 --force-share --output=json" returned: 0 in 0.230s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "d32a0bb2c868e7899e4205167ff4dee6b2bfe519" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "d32a0bb2c868e7899e4205167ff4dee6b2bfe519" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519 --force-share --output=json" returned: 0 in 0.227s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519,backing_fmt=raw /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519,backing_fmt=raw /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk 1073741824" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "d32a0bb2c868e7899e4205167ff4dee6b2bfe519" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.417s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Creating config drive at /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu8ojru7p {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.network.neutron [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updated VIF entry in instance network info cache for port 5b1fd2ee-3e0c-4951-8909-25b853d04b1c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.network.neutron [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu8ojru7p" returned: 0 in 0.063s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-97f76514-8974-4c8b-9c0e-35d58da39af0 req-5822b141-2e82-4040-b4d3-701fbd289281 service nova] Releasing lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519 --force-share --output=json" returned: 0 in 0.238s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Instance spawned successfully.
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Cannot resize image /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Ensure instance console log exists: /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:34 user nova-compute[75235]: INFO nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Took 11.47 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:34 user nova-compute[75235]: INFO nova.compute.manager [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Took 13.04 seconds to build instance.
Nov 29 19:01:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-327d06b9-d9aa-458c-ab31-749495694fbf tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.293s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Successfully updated port: 9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquired lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-changed-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Refreshing instance network info cache due to event network-changed-9bf5b734-6480-4406-bce5-25ed601aee83. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] Acquiring lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updating instance_info_cache with network_info: [{"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Releasing lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Instance network_info: |[{"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] Acquired lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.neutron [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Refreshing network info cache for port 9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Start _get_guest_xml network_info=[{"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T19:01:20Z,direct_url=<?>,disk_format='qcow2',id=31e26ebd-cc92-4474-aace-2d4d393bcc89,min_disk=0,min_ram=0,name='',owner='a9ed05a09e6b41f99481306e1c369fac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T19:01:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/sda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'scsi', 'image_id': '31e26ebd-cc92-4474-aace-2d4d393bcc89'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T19:01:20Z,direct_url=<?>,disk_format='qcow2',id=31e26ebd-cc92-4474-aace-2d4d393bcc89,min_disk=0,min_ram=0,name='',owner='a9ed05a09e6b41f99481306e1c369fac',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T19:01:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-622468875',display_name='tempest-AttachSCSIVolumeTestJSON-server-622468875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-622468875',id=8,image_ref='31e26ebd-cc92-4474-aace-2d4d393bcc89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGhuCjeyKIqzN8mwkbU2xnRiGs8x3HGRdaBOSBhNfsWX6gLPshosO9DLyFgyOM0Q0QSXJWcsOFNpvISVNhDt0KAhKHFlh4jdYc6TAtQz3nHTe1SbkA4B5ULhVKpiVyaeg==',key_name='tempest-keypair-211432928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f46132496c2942c7bbe25a049fa21b4a',ramdisk_id='',reservation_id='r-0uzfha7s',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='31e26ebd-cc92-4474-aace-2d4d393bcc89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-300747578',owner_user_name='tempest-AttachSCSIVolumeTestJSON-300747578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e5eb354d2a4fde953ac63aa8573d70',uuid=59547806-99f2-4fa7-8f73-4ed1bf2890c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Converting VIF {"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.objects.instance [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lazy-loading 'pci_devices' on Instance uuid 59547806-99f2-4fa7-8f73-4ed1bf2890c1 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:35 user nova-compute[75235]:   <uuid>59547806-99f2-4fa7-8f73-4ed1bf2890c1</uuid>
Nov 29 19:01:35 user nova-compute[75235]:   <name>instance-00000008</name>
Nov 29 19:01:35 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:35 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:35 user nova-compute[75235]:   <metadata>
Nov 29 19:01:35 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:35 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:35 user nova-compute[75235]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-622468875</nova:name>
Nov 29 19:01:35 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:35</nova:creationTime>
Nov 29 19:01:35 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:35 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:35 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:35 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:user uuid="d1e5eb354d2a4fde953ac63aa8573d70">tempest-AttachSCSIVolumeTestJSON-300747578-project-member</nova:user>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:project uuid="f46132496c2942c7bbe25a049fa21b4a">tempest-AttachSCSIVolumeTestJSON-300747578</nova:project>
Nov 29 19:01:35 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:35 user nova-compute[75235]:       <nova:root type="image" uuid="31e26ebd-cc92-4474-aace-2d4d393bcc89"/>
Nov 29 19:01:35 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:35 user nova-compute[75235]:         <nova:port uuid="9bf5b734-6480-4406-bce5-25ed601aee83">
Nov 29 19:01:35 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 19:01:35 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:35 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:35 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:35 user nova-compute[75235]:   </metadata>
Nov 29 19:01:35 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:35 user nova-compute[75235]:     <system>
Nov 29 19:01:35 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:35 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:35 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:35 user nova-compute[75235]:       <entry name="serial">59547806-99f2-4fa7-8f73-4ed1bf2890c1</entry>
Nov 29 19:01:35 user nova-compute[75235]:       <entry name="uuid">59547806-99f2-4fa7-8f73-4ed1bf2890c1</entry>
Nov 29 19:01:35 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:35 user nova-compute[75235]:     </system>
Nov 29 19:01:35 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:35 user nova-compute[75235]:   <os>
Nov 29 19:01:35 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:35 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:35 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:35 user nova-compute[75235]:   </os>
Nov 29 19:01:35 user nova-compute[75235]:   <features>
Nov 29 19:01:35 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:35 user nova-compute[75235]:     <apic/>
Nov 29 19:01:35 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:35 user nova-compute[75235]:   </features>
Nov 29 19:01:35 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:35 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:35 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:35 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:35 user nova-compute[75235]:   </clock>
Nov 29 19:01:35 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:35 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:35 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:35 user nova-compute[75235]:   </cpu>
Nov 29 19:01:35 user nova-compute[75235]:   <devices>
Nov 29 19:01:35 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:35 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:35 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk"/>
Nov 29 19:01:35 user nova-compute[75235]:       <target dev="sda" bus="scsi"/>
Nov 29 19:01:35 user nova-compute[75235]:       <address type="drive" controller="0" unit="0"/>
Nov 29 19:01:35 user nova-compute[75235]:     </disk>
Nov 29 19:01:35 user nova-compute[75235]:     <disk type="file" device="cdrom">
Nov 29 19:01:35 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 19:01:35 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.config"/>
Nov 29 19:01:35 user nova-compute[75235]:       <target dev="sdb" bus="scsi"/>
Nov 29 19:01:35 user nova-compute[75235]:       <address type="drive" controller="0" unit="1"/>
Nov 29 19:01:35 user nova-compute[75235]:     </disk>
Nov 29 19:01:35 user nova-compute[75235]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 19:01:35 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:35 user nova-compute[75235]:       <mac address="fa:16:3e:ad:1a:ec"/>
Nov 29 19:01:35 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:35 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:35 user nova-compute[75235]:       <target dev="tap9bf5b734-64"/>
Nov 29 19:01:35 user nova-compute[75235]:     </interface>
Nov 29 19:01:35 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:35 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/console.log" append="off"/>
Nov 29 19:01:35 user nova-compute[75235]:     </serial>
Nov 29 19:01:35 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:35 user nova-compute[75235]:     <video>
Nov 29 19:01:35 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:35 user nova-compute[75235]:     </video>
Nov 29 19:01:35 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:35 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:35 user nova-compute[75235]:     </rng>
Nov 29 19:01:35 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:35 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:35 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:35 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:35 user nova-compute[75235]:   </devices>
Nov 29 19:01:35 user nova-compute[75235]: </domain>
Nov 29 19:01:35 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-622468875',display_name='tempest-AttachSCSIVolumeTestJSON-server-622468875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-622468875',id=8,image_ref='31e26ebd-cc92-4474-aace-2d4d393bcc89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGhuCjeyKIqzN8mwkbU2xnRiGs8x3HGRdaBOSBhNfsWX6gLPshosO9DLyFgyOM0Q0QSXJWcsOFNpvISVNhDt0KAhKHFlh4jdYc6TAtQz3nHTe1SbkA4B5ULhVKpiVyaeg==',key_name='tempest-keypair-211432928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f46132496c2942c7bbe25a049fa21b4a',ramdisk_id='',reservation_id='r-0uzfha7s',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='31e26ebd-cc92-4474-aace-2d4d393bcc89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-300747578',owner_user_name='tempest-AttachSCSIVolumeTestJSON-300747578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e5eb354d2a4fde953ac63aa8573d70',uuid=59547806-99f2-4fa7-8f73-4ed1bf2890c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Converting VIF {"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG os_vif [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51bed425-37c9-5012-9e5e-580cf211e6de', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bf5b734-64, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bf5b734-64, col_values=(('qos', UUID('ca6f9547-4520-469e-8541-35e2ad31f8f5')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bf5b734-64, col_values=(('external_ids', {'iface-id': '9bf5b734-6480-4406-bce5-25ed601aee83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:1a:ec', 'vm-uuid': '59547806-99f2-4fa7-8f73-4ed1bf2890c1'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:35 user nova-compute[75235]: INFO os_vif [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64')
Nov 29 19:01:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No BDM found with device name sda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No VIF found with MAC fa:16:3e:ad:1a:ec, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Using config drive
Nov 29 19:01:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Creating config drive at /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.config
Nov 29 19:01:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfge7f4jv {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfge7f4jv" returned: 0 in 0.085s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG nova.network.neutron [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updated VIF entry in instance network info cache for port 9bf5b734-6480-4406-bce5-25ed601aee83. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG nova.network.neutron [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updating instance_info_cache with network_info: [{"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9290aa15-67b7-41ac-82ab-0c0515914d5b req-9cd759ce-e6c8-4cae-a24e-15f745638ce3 service nova] Releasing lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Instance spawned successfully.
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:40 user nova-compute[75235]: INFO nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Took 13.69 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:40 user nova-compute[75235]: DEBUG nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:40 user nova-compute[75235]: INFO nova.compute.manager [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Took 15.41 seconds to build instance.
Nov 29 19:01:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-23fab533-f4ed-470e-acc0-9f5cac87f61e tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.749s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-862f217d-6180-4cdd-9801-c3de3f6e6dd0 req-4af010bf-66d1-41d1-8465-53694ffe3c24 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-862f217d-6180-4cdd-9801-c3de3f6e6dd0 req-4af010bf-66d1-41d1-8465-53694ffe3c24 service nova] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-862f217d-6180-4cdd-9801-c3de3f6e6dd0 req-4af010bf-66d1-41d1-8465-53694ffe3c24 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-862f217d-6180-4cdd-9801-c3de3f6e6dd0 req-4af010bf-66d1-41d1-8465-53694ffe3c24 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-862f217d-6180-4cdd-9801-c3de3f6e6dd0 req-4af010bf-66d1-41d1-8465-53694ffe3c24 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] No waiting events found dispatching network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:41 user nova-compute[75235]: WARNING nova.compute.manager [req-862f217d-6180-4cdd-9801-c3de3f6e6dd0 req-4af010bf-66d1-41d1-8465-53694ffe3c24 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received unexpected event network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 for instance with vm_state active and task_state None.
Nov 29 19:01:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Instance spawned successfully.
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:42 user nova-compute[75235]: INFO nova.compute.claims [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Claim successful on node user
Nov 29 19:01:42 user nova-compute[75235]: INFO nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Took 10.95 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:42 user nova-compute[75235]: INFO nova.compute.manager [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Took 12.54 seconds to build instance.
Nov 29 19:01:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dd1639ed-ccff-4d68-9337-cf4f7e814300 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.730s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.026s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:43 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.policy [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f369822d9f140079b7a66196c1f5796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bab1863bb1b4b25b88f78ea64872054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:44 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Creating image(s)
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "/opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "/opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] No waiting events found dispatching network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:44 user nova-compute[75235]: WARNING nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received unexpected event network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 for instance with vm_state active and task_state None.
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:44 user nova-compute[75235]: WARNING nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c for instance with vm_state active and task_state None.
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:01:44 user nova-compute[75235]: WARNING nova.compute.manager [req-ed114e47-4f47-466f-a8e3-28460207fb93 req-280bcadc-d6f5-4cda-93df-8475710e1cd0 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c for instance with vm_state active and task_state None.
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.237s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.231s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk 1073741824" returned: 0 in 0.152s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.222s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Cannot resize image /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Ensure instance console log exists: /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Successfully created port: 0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:01:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Successfully updated port: 0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquired lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-changed-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Refreshing instance network info cache due to event network-changed-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] Acquiring lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updating instance_info_cache with network_info: [{"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Releasing lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Instance network_info: |[{"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] Acquired lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Refreshing network info cache for port 0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Start _get_guest_xml network_info=[{"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:46 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:46 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1770582735',display_name='tempest-VolumesAssistedSnapshotsTest-server-1770582735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1770582735',id=9,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmE0BQc4SNaQdNHBUDVYmzOWBarE560r1d8zzfSQAtnXCBPhpcHRdaoTEI3a4FZerIThHHvE1k04pQ74NmZTWo0V6Qsul/51KBnQkUtQkKpHvj7OXpAePyofj8jrK9TTg==',key_name='tempest-keypair-251671915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bab1863bb1b4b25b88f78ea64872054',ramdisk_id='',reservation_id='r-d20bq9me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-113932405',owner_user_name='tempest-VolumesAssistedSnapshotsTest-113932405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f369822d9f140079b7a66196c1f5796',uuid=0f6193ce-63f6-4a8a-a527-c2fd41cc178b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Converting VIF {"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.objects.instance [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:47 user nova-compute[75235]:   <uuid>0f6193ce-63f6-4a8a-a527-c2fd41cc178b</uuid>
Nov 29 19:01:47 user nova-compute[75235]:   <name>instance-00000009</name>
Nov 29 19:01:47 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:47 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:47 user nova-compute[75235]:   <metadata>
Nov 29 19:01:47 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:47 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:47 user nova-compute[75235]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1770582735</nova:name>
Nov 29 19:01:47 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:46</nova:creationTime>
Nov 29 19:01:47 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:47 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:47 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:47 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:user uuid="0f369822d9f140079b7a66196c1f5796">tempest-VolumesAssistedSnapshotsTest-113932405-project-member</nova:user>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:project uuid="5bab1863bb1b4b25b88f78ea64872054">tempest-VolumesAssistedSnapshotsTest-113932405</nova:project>
Nov 29 19:01:47 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:47 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:47 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:47 user nova-compute[75235]:         <nova:port uuid="0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af">
Nov 29 19:01:47 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 19:01:47 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:47 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:47 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:47 user nova-compute[75235]:   </metadata>
Nov 29 19:01:47 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:47 user nova-compute[75235]:     <system>
Nov 29 19:01:47 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:47 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:47 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:47 user nova-compute[75235]:       <entry name="serial">0f6193ce-63f6-4a8a-a527-c2fd41cc178b</entry>
Nov 29 19:01:47 user nova-compute[75235]:       <entry name="uuid">0f6193ce-63f6-4a8a-a527-c2fd41cc178b</entry>
Nov 29 19:01:47 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:47 user nova-compute[75235]:     </system>
Nov 29 19:01:47 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:47 user nova-compute[75235]:   <os>
Nov 29 19:01:47 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:47 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:47 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:47 user nova-compute[75235]:   </os>
Nov 29 19:01:47 user nova-compute[75235]:   <features>
Nov 29 19:01:47 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:47 user nova-compute[75235]:     <apic/>
Nov 29 19:01:47 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:47 user nova-compute[75235]:   </features>
Nov 29 19:01:47 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:47 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:47 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:47 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:47 user nova-compute[75235]:   </clock>
Nov 29 19:01:47 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:47 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:47 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:47 user nova-compute[75235]:   </cpu>
Nov 29 19:01:47 user nova-compute[75235]:   <devices>
Nov 29 19:01:47 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:47 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:47 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk"/>
Nov 29 19:01:47 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:47 user nova-compute[75235]:     </disk>
Nov 29 19:01:47 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:47 user nova-compute[75235]:       <mac address="fa:16:3e:67:b8:9d"/>
Nov 29 19:01:47 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:47 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:47 user nova-compute[75235]:       <target dev="tap0b9c347b-c8"/>
Nov 29 19:01:47 user nova-compute[75235]:     </interface>
Nov 29 19:01:47 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:47 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/console.log" append="off"/>
Nov 29 19:01:47 user nova-compute[75235]:     </serial>
Nov 29 19:01:47 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:47 user nova-compute[75235]:     <video>
Nov 29 19:01:47 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:47 user nova-compute[75235]:     </video>
Nov 29 19:01:47 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:47 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:47 user nova-compute[75235]:     </rng>
Nov 29 19:01:47 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:47 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:47 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:47 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:47 user nova-compute[75235]:   </devices>
Nov 29 19:01:47 user nova-compute[75235]: </domain>
Nov 29 19:01:47 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1770582735',display_name='tempest-VolumesAssistedSnapshotsTest-server-1770582735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1770582735',id=9,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmE0BQc4SNaQdNHBUDVYmzOWBarE560r1d8zzfSQAtnXCBPhpcHRdaoTEI3a4FZerIThHHvE1k04pQ74NmZTWo0V6Qsul/51KBnQkUtQkKpHvj7OXpAePyofj8jrK9TTg==',key_name='tempest-keypair-251671915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bab1863bb1b4b25b88f78ea64872054',ramdisk_id='',reservation_id='r-d20bq9me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-113932405',owner_user_name='tempest-VolumesAssistedSnapshotsTest-113932405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f369822d9f140079b7a66196c1f5796',uuid=0f6193ce-63f6-4a8a-a527-c2fd41cc178b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Converting VIF {"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG os_vif [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f460d36b-f80d-53b2-9d72-2a2e74e07b66', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b9c347b-c8, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b9c347b-c8, col_values=(('qos', UUID('f90e844b-5724-41eb-9c5c-80cfd961b25d')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b9c347b-c8, col_values=(('external_ids', {'iface-id': '0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:b8:9d', 'vm-uuid': '0f6193ce-63f6-4a8a-a527-c2fd41cc178b'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:47 user nova-compute[75235]: INFO os_vif [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8')
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] No VIF found with MAC fa:16:3e:67:b8:9d, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updated VIF entry in instance network info cache for port 0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updating instance_info_cache with network_info: [{"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6116c2cd-1072-4176-b117-1c59b0054056 req-6ec74b99-79c4-4725-85fe-598b88ab30e9 service nova] Releasing lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.66998291015625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 151f125a-f385-48a6-8d2a-71312aa14ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance aa2da6c4-f2d2-4598-9113-122b3ca34133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d7e65309-b31e-4e11-bc9c-495c13d276bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:01:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:01:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Instance spawned successfully.
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:01:51 user nova-compute[75235]: INFO nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Took 7.63 seconds to spawn the instance on the hypervisor.
Nov 29 19:01:51 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:01:51 user nova-compute[75235]: INFO nova.compute.manager [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Took 9.53 seconds to build instance.
Nov 29 19:01:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9b13cb52-8d11-4e58-9874-6b5d23f931b8 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.065s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:01:52 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 151f125a-f385-48a6-8d2a-71312aa14ed5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updating instance_info_cache with network_info: [{"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-151f125a-f385-48a6-8d2a-71312aa14ed5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:01:53 user nova-compute[75235]: INFO nova.compute.claims [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Claim successful on node user
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:01:53 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:01:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:01:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Creating image(s)
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "/opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "/opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG nova.policy [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2cf5f5fec284ca5acb4b2a23ccbdf3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2b53592e324e408146b428821ac2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.229s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.203s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk 1073741824" returned: 0 in 0.068s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Cannot resize image /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Ensure instance console log exists: /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:01:55 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Successfully created port: 4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:01:56 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Successfully updated port: 4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "refresh_cache-bc9d2f79-2f68-4818-9c92-a1c349bc13c2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquired lock "refresh_cache-bc9d2f79-2f68-4818-9c92-a1c349bc13c2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-changed-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Refreshing instance network info cache due to event network-changed-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] Acquiring lock "refresh_cache-bc9d2f79-2f68-4818-9c92-a1c349bc13c2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Updating instance_info_cache with network_info: [{"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Releasing lock "refresh_cache-bc9d2f79-2f68-4818-9c92-a1c349bc13c2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Instance network_info: |[{"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] Acquired lock "refresh_cache-bc9d2f79-2f68-4818-9c92-a1c349bc13c2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Refreshing network info cache for port 4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Start _get_guest_xml network_info=[{"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:01:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1826821391',display_name='tempest-VolumesNegativeTest-instance-1826821391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1826821391',id=10,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f2b53592e324e408146b428821ac2d2',ramdisk_id='',reservation_id='r-3fz23rlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1321064919',owner_user_name='tempest-VolumesNegativeTest-1321064919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:54Z,user_data=None,user_id='f2cf5f5fec284ca5acb4b2a23ccbdf3c',uuid=bc9d2f79-2f68-4818-9c92-a1c349bc13c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Converting VIF {"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lazy-loading 'pci_devices' on Instance uuid bc9d2f79-2f68-4818-9c92-a1c349bc13c2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:01:57 user nova-compute[75235]:   <uuid>bc9d2f79-2f68-4818-9c92-a1c349bc13c2</uuid>
Nov 29 19:01:57 user nova-compute[75235]:   <name>instance-0000000a</name>
Nov 29 19:01:57 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:01:57 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:01:57 user nova-compute[75235]:   <metadata>
Nov 29 19:01:57 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:01:57 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:01:57 user nova-compute[75235]:       <nova:name>tempest-VolumesNegativeTest-instance-1826821391</nova:name>
Nov 29 19:01:57 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:01:57</nova:creationTime>
Nov 29 19:01:57 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:01:57 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:01:57 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:01:57 user nova-compute[75235]:       <nova:owner>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:user uuid="f2cf5f5fec284ca5acb4b2a23ccbdf3c">tempest-VolumesNegativeTest-1321064919-project-member</nova:user>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:project uuid="2f2b53592e324e408146b428821ac2d2">tempest-VolumesNegativeTest-1321064919</nova:project>
Nov 29 19:01:57 user nova-compute[75235]:       </nova:owner>
Nov 29 19:01:57 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:01:57 user nova-compute[75235]:       <nova:ports>
Nov 29 19:01:57 user nova-compute[75235]:         <nova:port uuid="4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37">
Nov 29 19:01:57 user nova-compute[75235]:           <nova:ip type="fixed" address="192.168.233.99" ipVersion="4"/>
Nov 29 19:01:57 user nova-compute[75235]:         </nova:port>
Nov 29 19:01:57 user nova-compute[75235]:       </nova:ports>
Nov 29 19:01:57 user nova-compute[75235]:     </nova:instance>
Nov 29 19:01:57 user nova-compute[75235]:   </metadata>
Nov 29 19:01:57 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:01:57 user nova-compute[75235]:     <system>
Nov 29 19:01:57 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:01:57 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:01:57 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:01:57 user nova-compute[75235]:       <entry name="serial">bc9d2f79-2f68-4818-9c92-a1c349bc13c2</entry>
Nov 29 19:01:57 user nova-compute[75235]:       <entry name="uuid">bc9d2f79-2f68-4818-9c92-a1c349bc13c2</entry>
Nov 29 19:01:57 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:01:57 user nova-compute[75235]:     </system>
Nov 29 19:01:57 user nova-compute[75235]:   </sysinfo>
Nov 29 19:01:57 user nova-compute[75235]:   <os>
Nov 29 19:01:57 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:01:57 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:01:57 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:01:57 user nova-compute[75235]:   </os>
Nov 29 19:01:57 user nova-compute[75235]:   <features>
Nov 29 19:01:57 user nova-compute[75235]:     <acpi/>
Nov 29 19:01:57 user nova-compute[75235]:     <apic/>
Nov 29 19:01:57 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:01:57 user nova-compute[75235]:   </features>
Nov 29 19:01:57 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:01:57 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:01:57 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:01:57 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:01:57 user nova-compute[75235]:   </clock>
Nov 29 19:01:57 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:01:57 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:01:57 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:01:57 user nova-compute[75235]:   </cpu>
Nov 29 19:01:57 user nova-compute[75235]:   <devices>
Nov 29 19:01:57 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:01:57 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:01:57 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk"/>
Nov 29 19:01:57 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:01:57 user nova-compute[75235]:     </disk>
Nov 29 19:01:57 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:01:57 user nova-compute[75235]:       <mac address="fa:16:3e:d1:6c:82"/>
Nov 29 19:01:57 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:57 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:01:57 user nova-compute[75235]:       <target dev="tap4c02b1bb-d4"/>
Nov 29 19:01:57 user nova-compute[75235]:     </interface>
Nov 29 19:01:57 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:01:57 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/console.log" append="off"/>
Nov 29 19:01:57 user nova-compute[75235]:     </serial>
Nov 29 19:01:57 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:01:57 user nova-compute[75235]:     <video>
Nov 29 19:01:57 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:01:57 user nova-compute[75235]:     </video>
Nov 29 19:01:57 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:01:57 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:01:57 user nova-compute[75235]:     </rng>
Nov 29 19:01:57 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:01:57 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:01:57 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:01:57 user nova-compute[75235]:     </memballoon>
Nov 29 19:01:57 user nova-compute[75235]:   </devices>
Nov 29 19:01:57 user nova-compute[75235]: </domain>
Nov 29 19:01:57 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1826821391',display_name='tempest-VolumesNegativeTest-instance-1826821391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1826821391',id=10,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f2b53592e324e408146b428821ac2d2',ramdisk_id='',reservation_id='r-3fz23rlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1321064919',owner_user_name='tempest-VolumesNegativeTest-1321064919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:01:54Z,user_data=None,user_id='f2cf5f5fec284ca5acb4b2a23ccbdf3c',uuid=bc9d2f79-2f68-4818-9c92-a1c349bc13c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Converting VIF {"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG os_vif [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54401203-5a3d-5157-97a6-9dd6896c00aa', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c02b1bb-d4, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c02b1bb-d4, col_values=(('qos', UUID('275aee57-48df-4418-bdf6-f1f8f1f16576')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c02b1bb-d4, col_values=(('external_ids', {'iface-id': '4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:6c:82', 'vm-uuid': 'bc9d2f79-2f68-4818-9c92-a1c349bc13c2'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:57 user nova-compute[75235]: INFO os_vif [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4')
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:01:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] No VIF found with MAC fa:16:3e:d1:6c:82, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:01:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Updated VIF entry in instance network info cache for port 4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:01:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Updating instance_info_cache with network_info: [{"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:01:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1402ba3e-d87c-4e1a-8f49-9aad3f6a70c4 req-8c3fd15b-6772-4149-bf51-6b0829a515a6 service nova] Releasing lock "refresh_cache-bc9d2f79-2f68-4818-9c92-a1c349bc13c2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:01:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:01:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:02:02 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Instance spawned successfully.
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:02:02 user nova-compute[75235]: INFO nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 29 19:02:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:02:02 user nova-compute[75235]: INFO nova.compute.manager [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Took 9.32 seconds to build instance.
Nov 29 19:02:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4fd2ebbb-a491-4717-b898-253edf4f686d tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.443s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-d6a9cea4-6a02-4c21-bfb4-7f0b614093f5 req-934c57c2-dba9-4865-a1aa-9d6d445ed103 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d6a9cea4-6a02-4c21-bfb4-7f0b614093f5 req-934c57c2-dba9-4865-a1aa-9d6d445ed103 service nova] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d6a9cea4-6a02-4c21-bfb4-7f0b614093f5 req-934c57c2-dba9-4865-a1aa-9d6d445ed103 service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d6a9cea4-6a02-4c21-bfb4-7f0b614093f5 req-934c57c2-dba9-4865-a1aa-9d6d445ed103 service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-d6a9cea4-6a02-4c21-bfb4-7f0b614093f5 req-934c57c2-dba9-4865-a1aa-9d6d445ed103 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] No waiting events found dispatching network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:07 user nova-compute[75235]: WARNING nova.compute.manager [req-d6a9cea4-6a02-4c21-bfb4-7f0b614093f5 req-934c57c2-dba9-4865-a1aa-9d6d445ed103 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received unexpected event network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db for instance with vm_state active and task_state None.
Nov 29 19:02:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] No waiting events found dispatching network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received unexpected event network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] No waiting events found dispatching network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received unexpected event network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] No waiting events found dispatching network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received unexpected event network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] No waiting events found dispatching network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received unexpected event network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] No waiting events found dispatching network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received unexpected event network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] No waiting events found dispatching network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received unexpected event network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] No waiting events found dispatching network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:02:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f0e59fff-67bc-4880-8304-fef573e86db4 req-b35b22a5-c878-4128-b89e-c35d6777c6e9 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received unexpected event network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 for instance with vm_state active and task_state None.
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:09 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:02:09 user nova-compute[75235]: INFO nova.compute.claims [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Claim successful on node user
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:02:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:02:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:02:10 user nova-compute[75235]: INFO nova.virt.block_device [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Booting with volume cb8e0671-cbea-45ab-9711-3ed30315b46e at /dev/vda
Nov 29 19:02:10 user nova-compute[75235]: DEBUG nova.policy [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a51857517d6942179e224f4a2d26e797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626d60defd14c4fbdd1b3cb95f91dc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:02:10 user nova-compute[75235]: DEBUG os_brick.utils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:10 user nova-compute[75235]: INFO oslo.privsep.daemon [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp207_ypb3/privsep.sock']
Nov 29 19:02:10 user sudo[86446]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp207_ypb3/privsep.sock
Nov 29 19:02:10 user sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 19:02:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully created port: 4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:12 user sudo[86446]: pam_unix(sudo:session): session closed for user root
Nov 29 19:02:12 user nova-compute[75235]: INFO oslo.privsep.daemon [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Spawned new privsep daemon via rootwrap
Nov 29 19:02:12 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 19:02:12 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 19:02:12 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 19:02:12 user nova-compute[75235]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86449
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb01fa-6d24-4b4d-9d28-ec58f7d25ce4]: (2,) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully created port: 45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a8b5f-6eae-44f6-887b-aff69e8d691f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:12 user nova-compute[75235]: WARNING os_brick.initiator.connectors.nvmeof [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657e16b-973b-47f3-8a43-5195874dc1a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[43075b3a-3200-40fa-82e5-7a99f922a8ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c9544b-7daa-4090-a231-7e7978b7aad4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:12 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b527f70-e058-4ca3-9682-9440a6383c3e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG os_brick.utils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== get_connector_properties: return (1897ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating existing volume attachment record: d9cc14c4-eeba-4d94-95e2-8d4523b9f48d {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully created port: 5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully created port: a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully created port: e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: 4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-4188ed56-cc18-4a6e-982d-7829f4bdcc6c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port 4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8b8412bd-f967-43d9-86d0-953810912c57 req-a4bec3dd-7071-4f5c-b265-9ae38e4cd98a service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:02:16 user nova-compute[75235]: INFO nova.compute.claims [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Claim successful on node user
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: 6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:02:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:02:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:02:17 user nova-compute[75235]: INFO nova.virt.block_device [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Booting with volume a5f9108c-4497-471c-a921-47252881f848 at /dev/vda
Nov 29 19:02:17 user nova-compute[75235]: DEBUG os_brick.utils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f369ad63-831e-47ec-b05c-41176107a373]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b03bc8-21a8-4a9d-88c7-d9df7d11bc3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[092ed2f2-cc59-48c5-b16c-8756847278b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ca163-6634-4e4a-ba73-f7b8e9cfcd6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.policy [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '164edb16c9004e418c0c8ca4988d9131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b927f53f71b4768b4411cc6b9c46640', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:17 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc989e-464a-4a8e-b665-d8f69c7216c7]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG os_brick.utils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating existing volume attachment record: 2c519512-d007-4bf4-9a31-9d44ad3f8144 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: 0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-6e624b2a-3e38-49ff-815c-5d3dabb050b4. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.network.neutron [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port 6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:17 user nova-compute[75235]: DEBUG nova.network.neutron [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully created port: 86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-0dcb6032-2d17-488b-90d0-410caec37df5. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port 0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: 45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb37e12c-fd76-4173-8df2-6a6d081f6f26 req-7aa8d49f-8710-4aff-a22b-61378d98d328 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully created port: 9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-45eda44c-c6da-4458-96c8-dc8eeb11d7bc. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port 45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: 5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully created port: a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d580f122-7d7b-44ce-b555-c27b0c6ba155 req-7c7d556f-a9c1-4535-9f8e-8fd64d3e3d88 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:20 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:20 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully created port: 8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully created port: 78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-5d466bfe-13b0-41fe-ba7e-34231525e916. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port 5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Successfully updated port: e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-a04a5197-434c-404c-a405-05d55e00334e. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: 86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2595395c-7a9a-45be-ba80-920be3839828 req-0945f216-da90-43e9-a62f-682a7e145406 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:23 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: 2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:23 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-e0ed2b87-3c44-4a10-b698-788b87cbedf6. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance network_info: |[{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: 9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updated VIF entry in instance network info cache for port e0ed2b87-3c44-4a10-b698-788b87cbedf6. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-86cc49ca-6749-42d2-baf3-d5612b552fb3. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port 86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:24 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-2180ed4f-ef9b-478b-98d4-fc1191c8132f. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port 2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: 8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-a21488c6-77a7-46f8-a4e1-4bafd95c87ec. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-023c0f55-35d2-4feb-bd1b-59f5f56a0aba req-6278299d-fa09-4dee-9537-d246af00bf98 service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-9d300876-7a9b-4756-b1a3-40118556fd87. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port 9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Successfully updated port: 78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:02:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-a2ed01a1-0a46-453c-b542-37979837174f. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-8bb8b3ee-5a58-480c-b03c-87858cc2483a. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port 8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-282c540e-89dd-4efe-9bd8-44416ff2fd7c req-49286ddb-c71b-4408-b6cb-8d27d435b58b service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:02:26 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:02:27 user nova-compute[75235]: INFO nova.virt.block_device [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Booting with volume 7f4052f7-eb63-4b04-ae7b-a0022806d439 at /dev/vdb
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.utils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: INFO nova.virt.block_device [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Booting with volume 2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 at /dev/vdb
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9da7f-b5f7-4f6c-9692-a18d384dc30c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6d4859-f575-4da8-9e77-f6b9a4093c2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3702d5-ec74-4b6a-9b90-83679439a0a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d2534-768b-4358-92d9-26cc4811b697]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.utils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-78180abc-79e1-4b4f-bd98-3d77701f3863. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b3b34a-321a-4c8b-90a3-bde511964446]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:27 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8833725c-e4cf-45e7-bd12-b1cc4231270d]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG os_brick.utils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating existing volume attachment record: 6086569b-d1a4-4315-84aa-03fbb90bc30b {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[26436ef5-b82d-441a-a93d-e37c29c6f399]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b6c90-96ed-4cbe-893c-adfef2a98130]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b39d245-c2a2-496c-8bdd-e3799e8836c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:28 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5025d201-8a9d-467f-bbf0-36871a23dcf9]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG os_brick.utils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating existing volume attachment record: c2998758-2796-4e1c-a592-6aff7c2f8e9b {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance network_info: |[{"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port 78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updated VIF entry in instance network info cache for port 78180abc-79e1-4b4f-bd98-3d77701f3863. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-33cb47e0-cf11-4dea-a8e9-88647531e56f req-42040f1e-0d62-482a-9279-14da20ef2b3f service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:42 user nova-compute[75235]: INFO nova.virt.block_device [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Booting with volume d02d2a9a-a2d0-4665-8b26-5e745f8031bb at /dev/vdc
Nov 29 19:02:42 user nova-compute[75235]: DEBUG os_brick.utils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae53f73-42a7-4188-a89e-50a0b4ab26b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:42 user nova-compute[75235]: INFO nova.virt.block_device [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Booting with volume a7979675-b1f4-491c-83f7-075a6417de4d at /dev/vdc
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4cf4a3-e078-469b-b083-3a06d9ac3bdc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd6be8-ee89-4b73-91eb-df901189a3b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb7cba-7aac-4298-b280-fcf2391ea558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.utils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2503daba-b604-4d78-bdf3-9c14a5cf2877]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:43 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f24c85-3e7a-479d-9cb7-7890f7b3af4e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.utils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating existing volume attachment record: 6e1ed693-1098-467a-8aa5-1b7862b90020 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75bb4b0-4f6b-4086-91f0-d12edacada2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422c26a-1948-42df-9c5b-379573f7a717]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8dbd18-df46-4088-9845-d84cd5589f05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:43 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b233ad3-0436-4f12-9a25-2c36ad2298d4]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG os_brick.utils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:43 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating existing volume attachment record: f50041ac-4007-45f5-a9ee-58a4f25cd1cc {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:02:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:02:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=6974MB free_disk=25.539772033691406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 151f125a-f385-48a6-8d2a-71312aa14ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance aa2da6c4-f2d2-4598-9113-122b3ca34133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d7e65309-b31e-4e11-bc9c-495c13d276bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance bc9d2f79-2f68-4818-9c92-a1c349bc13c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lazy-loading 'flavor' on Instance uuid 151f125a-f385-48a6-8d2a-71312aa14ed5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:02:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:52 user nova-compute[75235]: INFO nova.compute.manager [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Attaching volume 34206296-29c8-4fdd-8582-f355e105557d to /dev/vdb
Nov 29 19:02:52 user nova-compute[75235]: DEBUG os_brick.utils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[339170d0-0e0c-45a0-986c-138c45fb03da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60a104e-fac6-490f-9f84-f361587e81a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79e99c-c17d-4548-b01b-05b4e8047205]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f607fe-4703-4b25-8594-03bded366f63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:02:52 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:02:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2985dfa2-2d2e-46bb-9e0b-9d56aa907482]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG os_brick.utils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updating existing volume attachment record: f6bea63e-e98c-41f0-9d1f-6ea6c5f227fc {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:02:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating instance_info_cache with network_info: [{"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:02:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-changed-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Refreshing instance network info cache due to event network-changed-d584745e-bfef-470a-8b88-a43e1f3d3f2b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] Acquiring lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] Acquired lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Refreshing network info cache for port d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:02:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updated VIF entry in instance network info cache for port d584745e-bfef-470a-8b88-a43e1f3d3f2b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating instance_info_cache with network_info: [{"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ea4d83-cc16-4710-9a30-c0822add8a5e req-9e55fbfe-cec6-4bbb-9ff1-90e271155e3a service nova] Releasing lock "refresh_cache-aa2da6c4-f2d2-4598-9113-122b3ca34133" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing instance network info cache due to event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing instance network info cache due to event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:02:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Creating image(s)
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Ensure instance console log exists: /opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Start _get_guest_xml network_info=[{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'd9cc14c4-eeba-4d94-95e2-8d4523b9f48d', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCBcTsIE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a281fe7-91eb-413d-bbbf-eefe229195a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb8e0671-cbea-45ab-9711-3ed30315b46e', 'serial': 'cb8e0671-cbea-45ab-9711-3ed30315b46e'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '6086569b-d1a4-4315-84aa-03fbb90bc30b', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFvRPSAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a281fe7-91eb-413d-bbbf-eefe229195a8', 'attached_at': '', 'detached_at': '', 'volume_id': '7f4052f7-eb63-4b04-ae7b-a0022806d439', 'serial': '7f4052f7-eb63-4b04-ae7b-a0022806d439'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '6e1ed693-1098-467a-8aa5-1b7862b90020', 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWRqjpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a281fe7-91eb-413d-bbbf-eefe229195a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd02d2a9a-a2d0-4665-8b26-5e745f8031bb', 'serial': 'd02d2a9a-a2d0-4665-8b26-5e745f8031bb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:02:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Creating image(s)
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Ensure instance console log exists: /opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Start _get_guest_xml network_info=[{"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '2c519512-d007-4bf4-9a31-9d44ad3f8144', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVukTMgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5f9108c-4497-471c-a921-47252881f848', 'serial': 'a5f9108c-4497-471c-a921-47252881f848'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'c2998758-2796-4e1c-a592-6aff7c2f8e9b', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrkpDsZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c', 'attached_at': '', 'detached_at': '', 'volume_id': '2f3a1872-ae40-4504-a9a2-fe8bf37cdd82', 'serial': '2f3a1872-ae40-4504-a9a2-fe8bf37cdd82'}, 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'f50041ac-4007-45f5-a9ee-58a4f25cd1cc', 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zibUjvPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7979675-b1f4-491c-83f7-075a6417de4d', 'serial': 'a7979675-b1f4-491c-83f7-075a6417de4d'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:02:59 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:02:59 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:02:59 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:02:59 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connector [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Factory for ISCSI on None {{(pid=75235) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCBcTsIE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:02:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:02:59 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVukTMgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:02:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73c5d3-201b-4124-a6c5-82c17b1eb7ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:02:59 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9824242b-cc18-4d57-bcae-a7ec9717da06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e] added
Nov 29 19:02:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41e9f27-6756-47be-8d5a-f64adfabdfc8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c90b8f-9e9d-47d6-b06d-6f68d330be17]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCBcTsIE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCBcTsIE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed49153-fab4-4b7c-9fb0-28fac62e0b44]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hCBcTsIE'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[807de908-dd3e-4353-89ad-9db5b08a0a44]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c86aa-93a5-4c8b-bfa4-957a9f9996ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:02:59 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:02:59 user nova-compute[75235]:  {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:02:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 19:02:59 user nova-compute[75235]: 
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d809bf73-293b-46d6-b2eb-896055bbd36b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260]
Nov 29 19:02:59 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260] successful.
Nov 29 19:02:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d03f7c0-d4b8-49b0-b8ca-328e7d9a8e1d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922bda1-6fdc-4f43-a1fc-64f733d5a5e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:02:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:02:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf2b1b-bfd7-4d30-83d4-f66e96e9a257]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCBcTsIE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updated VIF entry in instance network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dcaec70f-de50-4f9a-8d63-727b8d40d27b req-a2be5db2-1927-4613-8949-02c342fa740d service nova] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-changed-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Refreshing instance network info cache due to event network-changed-28cea0d8-5bab-4184-ad2f-5e9bc62110db. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Refreshing network info cache for port 28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updated VIF entry in instance network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:02:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-519b4355-f0e4-41bf-aee5-4877cf91c725 req-9d0b3cc8-af5c-465c-b0b3-08b744ec3a35 service nova] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG nova.network.neutron [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updated VIF entry in instance network info cache for port 28cea0d8-5bab-4184-ad2f-5e9bc62110db. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG nova.network.neutron [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-17ea44ac-ffa1-44a5-a597-1b4267820db3 req-4a521b80-c5c6-40d9-8b64-f3594049e6e8 service nova] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:03:00 user nova-compute[75235]: INFO nova.compute.manager [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] instance snapshotting
Nov 29 19:03:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Beginning live snapshot process
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23130333435383930', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130333435383930', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.305s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:00 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:00 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cf8fd-d100-4bc6-9d72-1318587d5c5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:00 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFvRPSAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:00 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca3ffff-6503-457c-bade-3bd989837f07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848] added
Nov 29 19:03:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e40f929-56d8-4926-8a35-2c8f7a442e7b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d94fce-9004-412a-a6e0-c77587364f67]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVukTMgs {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVukTMgs" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1c758-7832-48e4-9df7-a7b339d6e384]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVukTMgs'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2573468-7005-486d-9888-06eda016599c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuSfmzYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:00 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d786587c-2423-4877-afc6-44c347ec1aca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8004ceff-af6c-459a-bf1c-5976332dbad2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260]
Nov 29 19:03:00 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58e7567-a23d-42c0-8233-055dcdd1c684]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4546df9-d8bd-4478-88e6-98e8db91936e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:00 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:00 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4934be-f790-4e2c-bf03-b82ed8763a5c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVukTMgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfhfuxl8e/23f43473a493475d85d58660ac4e2260.delta 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfhfuxl8e/23f43473a493475d85d58660ac4e2260.delta 1073741824" returned: 0 in 0.045s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 19:03:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75235) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 19:03:01 user nova-compute[75235]: INFO nova.virt.libvirt.host [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] UEFI support detected
Nov 29 19:03:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== connect_volume: return (2673ms) {'type': 'block', 'scsi_wwn': '26564353231383832', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564353231383832', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.328s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:01 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:01 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e2f35-e62a-4c87-a35c-7474bb607e3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:01 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrkpDsZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:01 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ba64b-a654-4a19-8b18-54637f459180]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439] added
Nov 29 19:03:01 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162a4cd-8272-4700-88f3-e645572b60ef]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0c8eb7-1a45-4073-9274-b3a1926769d7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFvRPSAU {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFvRPSAU" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bb6055-2621-4dfd-9de2-43b7d982cf04]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFvRPSAU'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e454dc26-1aeb-4952-be78-e2107bc5df61]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe58d115-520b-444d-aaf4-9a18bb72aa4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:02 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:02 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6809f307-1a5a-4534-85ab-aa33b16f4c8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260]
Nov 29 19:03:02 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e169ea-9989-4ddd-bf5c-2bd27e62f73a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e867a-b58d-46eb-aa51-dc85fa25be22]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:02 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:02 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:02 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:02 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ffd48-cc0d-4445-a3c2-896a6219942c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFvRPSAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:03:02 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 19:03:02 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfhfuxl8e/23f43473a493475d85d58660ac4e2260.delta /opt/stack/data/nova/instances/snapshots/tmpfhfuxl8e/23f43473a493475d85d58660ac4e2260 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:02 user nova-compute[75235]: INFO nova.compute.manager [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Shelving
Nov 29 19:03:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfhfuxl8e/23f43473a493475d85d58660ac4e2260.delta /opt/stack/data/nova/instances/snapshots/tmpfhfuxl8e/23f43473a493475d85d58660ac4e2260" returned: 0 in 0.597s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Snapshot extracted, beginning image upload
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a9ff15a-3b6d-4f92-8496-b917805b1bde req-5cba9498-d37a-482d-8e15-d30046af8164 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a9ff15a-3b6d-4f92-8496-b917805b1bde req-5cba9498-d37a-482d-8e15-d30046af8164 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a9ff15a-3b6d-4f92-8496-b917805b1bde req-5cba9498-d37a-482d-8e15-d30046af8164 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a9ff15a-3b6d-4f92-8496-b917805b1bde req-5cba9498-d37a-482d-8e15-d30046af8164 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a9ff15a-3b6d-4f92-8496-b917805b1bde req-5cba9498-d37a-482d-8e15-d30046af8164 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:03 user nova-compute[75235]: WARNING nova.compute.manager [req-2a9ff15a-3b6d-4f92-8496-b917805b1bde req-5cba9498-d37a-482d-8e15-d30046af8164 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state shelving.
Nov 29 19:03:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== connect_volume: return (2738ms) {'type': 'block', 'scsi_wwn': '23933343839383731', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933343839383731', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.599s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:03 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:03 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b95a99-ee82-4c1e-b98b-34d49dcee4db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:03 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWRqjpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:03 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9d538-468f-4e7e-b669-81ed25d0018b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d] added
Nov 29 19:03:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7cc5e-696f-47fc-987c-620231c993b4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0b215-b6e7-497a-9826-0930cb7ae691]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuSfmzYa {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuSfmzYa" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd071733-fa60-44c2-b6c9-1062bb584453]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuSfmzYa'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.objects.instance [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid aa2da6c4-f2d2-4598-9113-122b3ca34133 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6b00ac-730f-477c-a7eb-0db3c365b477]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409750c-42ef-4e05-8c83-ffd8cd43a9f2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14a41ca-0e91-433d-9814-52525436c2a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260]
Nov 29 19:03:03 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446ae0a-3e31-4d63-85cb-3babe37832a6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4663bb24-a7ed-42b2-8379-09a45e229468]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:03 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance destroyed successfully.
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b58440-1400-4b67-a479-82c813c6f882]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuSfmzYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:03 user nova-compute[75235]: INFO nova.compute.manager [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Attaching volume 88944f9d-f745-4dea-9ba0-21d2b4f13a2d to /dev/vdb
Nov 29 19:03:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Beginning cold snapshot process
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.utils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.050s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81a657c-69aa-4adc-8dbe-4b42508af20c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e1e290-7eb0-439d-8013-107d592caece]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b88b46-6079-4345-ab48-fe4582b6f4db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4b510e-1747-462d-8aba-e9fc3b3e82c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk /opt/stack/data/nova/instances/snapshots/tmp6hm00inv/c38e6dec806744cebd0e6cf873f738ec {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:03 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:03:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e267b-dfc2-4504-9f55-e4a64951855f]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG os_brick.utils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== get_connector_properties: return (220ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:03 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating existing volume attachment record: 3d45030c-e260-443c-b018-97949467a55b {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] <== connect_volume: return (3943ms) {'type': 'block', 'scsi_wwn': '23832306463383131', 'path': '/dev/sde'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832306463383131', 'path': '/dev/sde'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.711s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:04 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lazy-loading 'flavor' on Instance uuid 151f125a-f385-48a6-8d2a-71312aa14ed5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600e075-25b1-4afc-a4c3-6b35e36984b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:04 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:03:04 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:04 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:03:04 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:04 user nova-compute[75235]:   <serial>34206296-29c8-4fdd-8582-f355e105557d</serial>
Nov 29 19:03:04 user nova-compute[75235]: </disk>
Nov 29 19:03:04 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2af8a00-f16a-4bc8-a949-338cae6e8e80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82] added
Nov 29 19:03:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4696f3c8-13d5-4873-8925-419503df4901]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk /opt/stack/data/nova/instances/snapshots/tmp6hm00inv/c38e6dec806744cebd0e6cf873f738ec" returned: 0 in 0.779s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Snapshot extracted, beginning image upload
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c14a5bd-c750-4dc6-a628-4b4d0f4939c2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrkpDsZC {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SrkpDsZC" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca9bd02-04d0-4115-b7a3-ed5643ebd48f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SrkpDsZC'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[37049bdf-34c3-4951-bc30-1acc6668bbad]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d902ecc-1f12-44d6-b33e-70f5a474040a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a955cb8-9a27-4323-b01a-1a2002086f8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260]
Nov 29 19:03:04 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[45120620-0d85-4e5e-9487-51c24ecd2bc3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900740e-03d9-4cbd-8048-4a3a6de37caf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:04 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8409b96e-b12a-48f6-880e-e221d3b098e1]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrkpDsZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-29801f6a-0f2c-41a4-8956-2b09f9ec9074 req-a3056521-bf0d-4718-94de-4b29bf0bf194 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-29801f6a-0f2c-41a4-8956-2b09f9ec9074 req-a3056521-bf0d-4718-94de-4b29bf0bf194 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-29801f6a-0f2c-41a4-8956-2b09f9ec9074 req-a3056521-bf0d-4718-94de-4b29bf0bf194 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-29801f6a-0f2c-41a4-8956-2b09f9ec9074 req-a3056521-bf0d-4718-94de-4b29bf0bf194 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-29801f6a-0f2c-41a4-8956-2b09f9ec9074 req-a3056521-bf0d-4718-94de-4b29bf0bf194 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:05 user nova-compute[75235]: WARNING nova.compute.manager [req-29801f6a-0f2c-41a4-8956-2b09f9ec9074 req-a3056521-bf0d-4718-94de-4b29bf0bf194 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 19:03:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] No VIF found with MAC fa:16:3e:68:af:5f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c9d28824-af0a-42c4-b2e8-83c3bdc69d76 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.151s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Snapshot image upload complete
Nov 29 19:03:05 user nova-compute[75235]: INFO nova.compute.manager [None req-7b5ae541-3a59-4a44-bd24-aed98835102d tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Took 5.63 seconds to snapshot the instance on the hypervisor.
Nov 29 19:03:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== connect_volume: return (4069ms) {'type': 'block', 'scsi_wwn': '26135636661313262', 'path': '/dev/sdf'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135636661313262', 'path': '/dev/sdf'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.671s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:05 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67cf9bb-bb46-4642-b791-9700c3823ed7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:06 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zibUjvPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:06 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a145afd-2045-4963-92bc-c9042e83e700]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb] added
Nov 29 19:03:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57cc577-6e28-4e96-81e2-624645e2b0d9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae4a2e-98b2-4812-a94b-54058de6d269]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxWRqjpM {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GxWRqjpM" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ae5c1-df41-47b5-b237-a6367e988041]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GxWRqjpM'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3538c3-d594-4e1f-927f-f71578f37c85]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d368d74-0247-4ba6-b26e-1ae940ba9784]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e432866-f487-4ab9-9196-fa2bfa282370]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260]
Nov 29 19:03:06 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:06 user nova-compute[75235]: INFO nova.compute.manager [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Terminating instance
Nov 29 19:03:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b09346e-4aa2-4fee-b534-160d8f0a70dd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3981fe3-61a4-4b2b-866c-59e53a1b6205]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:06 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01b1c3-733b-49e7-91c4-15354d6a5445]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWRqjpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-7ee790ba-21be-4721-bddb-4e8587a2fc65 req-8ad3fbf6-1224-476b-bf18-47cb8b0b46de service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-vif-unplugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7ee790ba-21be-4721-bddb-4e8587a2fc65 req-8ad3fbf6-1224-476b-bf18-47cb8b0b46de service nova] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7ee790ba-21be-4721-bddb-4e8587a2fc65 req-8ad3fbf6-1224-476b-bf18-47cb8b0b46de service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7ee790ba-21be-4721-bddb-4e8587a2fc65 req-8ad3fbf6-1224-476b-bf18-47cb8b0b46de service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-7ee790ba-21be-4721-bddb-4e8587a2fc65 req-8ad3fbf6-1224-476b-bf18-47cb8b0b46de service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] No waiting events found dispatching network-vif-unplugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-7ee790ba-21be-4721-bddb-4e8587a2fc65 req-8ad3fbf6-1224-476b-bf18-47cb8b0b46de service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-vif-unplugged-d3d47ecf-b064-4675-af30-06ec91e3f96d for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:03:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Instance destroyed successfully.
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lazy-loading 'resources' on Instance uuid 151f125a-f385-48a6-8d2a-71312aa14ed5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-573950174',display_name='tempest-DeleteServersTestJSON-server-573950174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-573950174',id=1,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9abbc576f624e2baa97407069b233b9',ramdisk_id='',reservation_id='r-i07ykxfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-595916133',owner_user_name='tempest-DeleteServersTestJSON-595916133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:13Z,user_data=None,user_id='9bc8bd57cf474a43a211fd6f87188baa',uuid=151f125a-f385-48a6-8d2a-71312aa14ed5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Converting VIF {"id": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "address": "fa:16:3e:68:af:5f", "network": {"id": "059425da-b040-450b-a4d1-7cb2c3fa19c1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2063826070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9abbc576f624e2baa97407069b233b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d47ecf-b0", "ovs_interfaceid": "d3d47ecf-b064-4675-af30-06ec91e3f96d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_vif [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d47ecf-b0, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64ff6e5e-78f5-4109-b9b7-7729ecb32169) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: INFO os_vif [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:af:5f,bridge_name='br-int',has_traffic_filtering=True,id=d3d47ecf-b064-4675-af30-06ec91e3f96d,network=Network(059425da-b040-450b-a4d1-7cb2c3fa19c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d47ecf-b0')
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuSfmzYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:07 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== connect_volume: return (4052ms) {'type': 'block', 'scsi_wwn': '23734623334633239', 'path': '/dev/sdg'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734623334633239', 'path': '/dev/sdg'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.344s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:07 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:07 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9a5bf7-4e5e-4b6c-b347-5289e00a76b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:07 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a281fe7-91eb-413d-bbbf-eefe229195a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c30aca7-a245-4192-a344-5577b85e0b80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Snapshot image upload complete
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d] added
Nov 29 19:03:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:03:07 user nova-compute[75235]:   <uuid>6a281fe7-91eb-413d-bbbf-eefe229195a8</uuid>
Nov 29 19:03:07 user nova-compute[75235]:   <name>instance-0000000b</name>
Nov 29 19:03:07 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:03:07 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:03:07 user nova-compute[75235]:   <metadata>
Nov 29 19:03:07 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:03:07 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:03:07 user nova-compute[75235]:       <nova:name>tempest-device-tagging-server-771915300</nova:name>
Nov 29 19:03:07 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:02:59</nova:creationTime>
Nov 29 19:03:07 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:03:07 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:03:07 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:03:07 user nova-compute[75235]:       <nova:owner>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:user uuid="a51857517d6942179e224f4a2d26e797">tempest-TaggedBootDevicesTest-397264967-project-member</nova:user>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:project uuid="1626d60defd14c4fbdd1b3cb95f91dc1">tempest-TaggedBootDevicesTest-397264967</nova:project>
Nov 29 19:03:07 user nova-compute[75235]:       </nova:owner>
Nov 29 19:03:07 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:03:07 user nova-compute[75235]:       <nova:ports>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="4188ed56-cc18-4a6e-982d-7829f4bdcc6c">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="6e624b2a-3e38-49ff-815c-5d3dabb050b4">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="0dcb6032-2d17-488b-90d0-410caec37df5">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.9" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="45eda44c-c6da-4458-96c8-dc8eeb11d7bc">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="5d466bfe-13b0-41fe-ba7e-34231525e916">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="a04a5197-434c-404c-a405-05d55e00334e">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:         <nova:port uuid="e0ed2b87-3c44-4a10-b698-788b87cbedf6">
Nov 29 19:03:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 19:03:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:07 user nova-compute[75235]:       </nova:ports>
Nov 29 19:03:07 user nova-compute[75235]:     </nova:instance>
Nov 29 19:03:07 user nova-compute[75235]:   </metadata>
Nov 29 19:03:07 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:03:07 user nova-compute[75235]:     <system>
Nov 29 19:03:07 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:03:07 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:03:07 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:03:07 user nova-compute[75235]:       <entry name="serial">6a281fe7-91eb-413d-bbbf-eefe229195a8</entry>
Nov 29 19:03:07 user nova-compute[75235]:       <entry name="uuid">6a281fe7-91eb-413d-bbbf-eefe229195a8</entry>
Nov 29 19:03:07 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:03:07 user nova-compute[75235]:     </system>
Nov 29 19:03:07 user nova-compute[75235]:   </sysinfo>
Nov 29 19:03:07 user nova-compute[75235]:   <os>
Nov 29 19:03:07 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:03:07 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:03:07 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:03:07 user nova-compute[75235]:   </os>
Nov 29 19:03:07 user nova-compute[75235]:   <features>
Nov 29 19:03:07 user nova-compute[75235]:     <acpi/>
Nov 29 19:03:07 user nova-compute[75235]:     <apic/>
Nov 29 19:03:07 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:03:07 user nova-compute[75235]:   </features>
Nov 29 19:03:07 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:03:07 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:03:07 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:03:07 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:03:07 user nova-compute[75235]:   </clock>
Nov 29 19:03:07 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:03:07 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:03:07 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:03:07 user nova-compute[75235]:   </cpu>
Nov 29 19:03:07 user nova-compute[75235]:   <devices>
Nov 29 19:03:07 user nova-compute[75235]:     <disk type="file" device="cdrom">
Nov 29 19:03:07 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 19:03:07 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8/disk.config"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="hda" bus="ide"/>
Nov 29 19:03:07 user nova-compute[75235]:     </disk>
Nov 29 19:03:07 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:03:07 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:07 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <serial>cb8e0671-cbea-45ab-9711-3ed30315b46e</serial>
Nov 29 19:03:07 user nova-compute[75235]:     </disk>
Nov 29 19:03:07 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:03:07 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:07 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <serial>7f4052f7-eb63-4b04-ae7b-a0022806d439</serial>
Nov 29 19:03:07 user nova-compute[75235]:     </disk>
Nov 29 19:03:07 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:03:07 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:07 user nova-compute[75235]:       <source dev="/dev/sdg"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="vdc" bus="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <serial>d02d2a9a-a2d0-4665-8b26-5e745f8031bb</serial>
Nov 29 19:03:07 user nova-compute[75235]:     </disk>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:f8:cc:a6"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tap4188ed56-cc"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:7c:0e:65"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tap6e624b2a-3e"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:47:7d:5b"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tap0dcb6032-2d"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:cd:b2:8d"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tap45eda44c-c6"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:4b:44:c1"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tap5d466bfe-13"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:5a:d9:a8"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tapa04a5197-43"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:07 user nova-compute[75235]:       <mac address="fa:16:3e:af:19:87"/>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:07 user nova-compute[75235]:       <target dev="tape0ed2b87-3c"/>
Nov 29 19:03:07 user nova-compute[75235]:     </interface>
Nov 29 19:03:07 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:03:07 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8/console.log" append="off"/>
Nov 29 19:03:07 user nova-compute[75235]:     </serial>
Nov 29 19:03:07 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:03:07 user nova-compute[75235]:     <video>
Nov 29 19:03:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:07 user nova-compute[75235]:     </video>
Nov 29 19:03:07 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:03:07 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:03:07 user nova-compute[75235]:     </rng>
Nov 29 19:03:07 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:03:07 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:03:07 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:03:07 user nova-compute[75235]:     </memballoon>
Nov 29 19:03:07 user nova-compute[75235]:   </devices>
Nov 29 19:03:07 user nova-compute[75235]: </domain>
Nov 29 19:03:07 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '897661f8-a2ad-5729-abf0-6c0628832454', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35dbe1-90f2-4abe-b316-78c039d44e6b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4188ed56-cc, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4188ed56-cc, col_values=(('qos', UUID('1755b983-59fd-4e17-b052-46d1aee6a529')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4188ed56-cc, col_values=(('external_ids', {'iface-id': '4188ed56-cc18-4a6e-982d-7829f4bdcc6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:cc:a6', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1236964b-3236-4ad1-ae2a-92989bd9ce3e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zibUjvPK {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc')
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd970e791-72d7-5c41-93be-009b6f2a99ad', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zibUjvPK" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca048a-929f-4a36-8004-33928238445f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zibUjvPK'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[84990e92-d494-42d4-a3e4-7cf48f46367d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e624b2a-3e, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e624b2a-3e, col_values=(('qos', UUID('9e645523-0d18-4f5d-bdc3-c90daee91d87')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e624b2a-3e, col_values=(('external_ids', {'iface-id': '6e624b2a-3e38-49ff-815c-5d3dabb050b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:0e:65', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: INFO nova.compute.manager [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Shelve offloading
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance destroyed successfully.
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b50aa5-68ba-4792-a322-36df59987bcf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:07 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e')
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ff5ee48-a1e2-549a-9b00-932d6b6ee4da', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dcb6032-2d, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dcb6032-2d, col_values=(('qos', UUID('90cb7a75-39e7-4cbd-bd1c-56e48562e7cc')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dcb6032-2d, col_values=(('external_ids', {'iface-id': '0dcb6032-2d17-488b-90d0-410caec37df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:7d:5b', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d689df-944a-4474-9d6e-f7c75233aa97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260]
Nov 29 19:03:08 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d')
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfca05-c4ea-44ce-a300-aabe9176c16f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a77e7bf-7006-5436-8cfb-9fe2fdb1ff4f', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce83e6-84d2-4b5d-9ba2-8beb13001cfe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:08 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.723s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2439a13-e504-431f-a70a-8152b495c998]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zibUjvPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45eda44c-c6, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45eda44c-c6, col_values=(('qos', UUID('f9c78119-0b79-4db1-8b96-2b53b214acb0')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45eda44c-c6, col_values=(('external_ids', {'iface-id': '45eda44c-c6da-4458-96c8-dc8eeb11d7bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:b2:8d', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6')
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15261b2f-f94d-558c-b0dd-280f76bc3308', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d466bfe-13, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d466bfe-13, col_values=(('qos', UUID('814053eb-0ec4-4268-a391-3457ac5ccdfd')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d466bfe-13, col_values=(('external_ids', {'iface-id': '5d466bfe-13b0-41fe-ba7e-34231525e916', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:44:c1', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13')
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc2313df-aebe-56be-8140-6a9b8a06fe36', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa04a5197-43, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa04a5197-43, col_values=(('qos', UUID('5605bc41-2986-4d5f-93d5-1e71309e84bd')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa04a5197-43, col_values=(('external_ids', {'iface-id': 'a04a5197-434c-404c-a405-05d55e00334e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:d9:a8', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43')
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c52cc98-7cd2-57d9-8274-ce858da16c70', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0ed2b87-3c, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0ed2b87-3c, col_values=(('qos', UUID('6af4fc2f-1fec-4093-9ce1-f28c23d80109')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0ed2b87-3c, col_values=(('external_ids', {'iface-id': 'e0ed2b87-3c44-4a10-b698-788b87cbedf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:19:87', 'vm-uuid': '6a281fe7-91eb-413d-bbbf-eefe229195a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: INFO os_vif [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c')
Nov 29 19:03:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b15858f-a408-41ba-a575-fc17e109474a req-359e0bbc-4ed4-40b0-93f9-52b62295400f service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b15858f-a408-41ba-a575-fc17e109474a req-359e0bbc-4ed4-40b0-93f9-52b62295400f service nova] Acquiring lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b15858f-a408-41ba-a575-fc17e109474a req-359e0bbc-4ed4-40b0-93f9-52b62295400f service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b15858f-a408-41ba-a575-fc17e109474a req-359e0bbc-4ed4-40b0-93f9-52b62295400f service nova] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b15858f-a408-41ba-a575-fc17e109474a req-359e0bbc-4ed4-40b0-93f9-52b62295400f service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] No waiting events found dispatching network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:08 user nova-compute[75235]: WARNING nova.compute.manager [req-5b15858f-a408-41ba-a575-fc17e109474a req-359e0bbc-4ed4-40b0-93f9-52b62295400f service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received unexpected event network-vif-plugged-d3d47ecf-b064-4675-af30-06ec91e3f96d for instance with vm_state active and task_state deleting.
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] No BDM found with device name hda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] No VIF found with MAC fa:16:3e:f8:cc:a6, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] No VIF found with MAC fa:16:3e:4b:44:c1, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Using config drive
Nov 29 19:03:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Creating config drive at /opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8/disk.config
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsdihq4mz {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsdihq4mz" returned: 0 in 0.077s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance destroyed successfully.
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'resources' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1165392797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1165392797',id=3,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEII1tQquSsQcIVp/DbVQ39O0BcTO+EYsQFQm66AEFwNZL0nvH2fKVj0GY/eWa3Ziw3XMeigv16XYXD6yBlHC+b3T363mzu5UTvcexbwRIQkE+Uw1QKaYWWKiTeYDiqNiw==',key_name='tempest-keypair-1094556375',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-e0vwlvoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member',shelved_at='2023-11-29T19:03:07.814020',shelved_host='user',shelved_image_id='2a06338f-b0a3-480e-9e2e-49202a315c43'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=eafeb96d-7762-4d67-b3ff-e1221296ecb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_vif [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.765s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== connect_volume: return (3110ms) {'type': 'block', 'scsi_wwn': '26237616130613632', 'path': '/dev/sdh'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237616130613632', 'path': '/dev/sdh'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing instance network info cache due to event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.neutron [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62fcb2af-32, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.980s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fdeb82-818f-4dd1-bd09-f3582574046b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:03:09 user nova-compute[75235]: No targets found.
Nov 29 19:03:09 user nova-compute[75235]: iSNS:
Nov 29 19:03:09 user nova-compute[75235]: No targets found.
Nov 29 19:03:09 user nova-compute[75235]: STATIC:
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:03:09 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:09 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:09 user nova-compute[75235]: FIRMWARE:
Nov 29 19:03:09 user nova-compute[75235]: No targets found.
Nov 29 19:03:09 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:03:09 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:03:09 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b38a02-f159-4f2b-98ac-fa01b50ebbe6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lazy-loading 'pci_devices' on Instance uuid 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf13c179-4f87-458c-9384-cb71f400de0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6baadef8-48ca-452c-b551-773f19a94373) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:09 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:09 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:09 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565052cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d'): ({'sde'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Removing single pathed devices sde {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:03:09 user nova-compute[75235]:   <uuid>31eaaa64-f6cb-4e8a-bf81-d349cf72c34c</uuid>
Nov 29 19:03:09 user nova-compute[75235]:   <name>instance-0000000c</name>
Nov 29 19:03:09 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:03:09 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:03:09 user nova-compute[75235]:   <metadata>
Nov 29 19:03:09 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:03:09 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:03:09 user nova-compute[75235]:       <nova:name>tempest-device-tagging-server-660231169</nova:name>
Nov 29 19:03:09 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:02:59</nova:creationTime>
Nov 29 19:03:09 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:03:09 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:03:09 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:03:09 user nova-compute[75235]:       <nova:owner>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:user uuid="164edb16c9004e418c0c8ca4988d9131">tempest-TaggedBootDevicesTest_v242-1070290409-project-member</nova:user>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:project uuid="7b927f53f71b4768b4411cc6b9c46640">tempest-TaggedBootDevicesTest_v242-1070290409</nova:project>
Nov 29 19:03:09 user nova-compute[75235]:       </nova:owner>
Nov 29 19:03:09 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:03:09 user nova-compute[75235]:       <nova:ports>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="86cc49ca-6749-42d2-baf3-d5612b552fb3">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="2180ed4f-ef9b-478b-98d4-fc1191c8132f">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="a21488c6-77a7-46f8-a4e1-4bafd95c87ec">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="9d300876-7a9b-4756-b1a3-40118556fd87">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="a2ed01a1-0a46-453c-b542-37979837174f">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="8bb8b3ee-5a58-480c-b03c-87858cc2483a">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:         <nova:port uuid="78180abc-79e1-4b4f-bd98-3d77701f3863">
Nov 29 19:03:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 19:03:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:03:09 user nova-compute[75235]:       </nova:ports>
Nov 29 19:03:09 user nova-compute[75235]:     </nova:instance>
Nov 29 19:03:09 user nova-compute[75235]:   </metadata>
Nov 29 19:03:09 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:03:09 user nova-compute[75235]:     <system>
Nov 29 19:03:09 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:03:09 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:03:09 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:03:09 user nova-compute[75235]:       <entry name="serial">31eaaa64-f6cb-4e8a-bf81-d349cf72c34c</entry>
Nov 29 19:03:09 user nova-compute[75235]:       <entry name="uuid">31eaaa64-f6cb-4e8a-bf81-d349cf72c34c</entry>
Nov 29 19:03:09 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:03:09 user nova-compute[75235]:     </system>
Nov 29 19:03:09 user nova-compute[75235]:   </sysinfo>
Nov 29 19:03:09 user nova-compute[75235]:   <os>
Nov 29 19:03:09 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:03:09 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:03:09 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:03:09 user nova-compute[75235]:   </os>
Nov 29 19:03:09 user nova-compute[75235]:   <features>
Nov 29 19:03:09 user nova-compute[75235]:     <acpi/>
Nov 29 19:03:09 user nova-compute[75235]:     <apic/>
Nov 29 19:03:09 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:03:09 user nova-compute[75235]:   </features>
Nov 29 19:03:09 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:03:09 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:03:09 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:03:09 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:03:09 user nova-compute[75235]:   </clock>
Nov 29 19:03:09 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:03:09 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:03:09 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:03:09 user nova-compute[75235]:   </cpu>
Nov 29 19:03:09 user nova-compute[75235]:   <devices>
Nov 29 19:03:09 user nova-compute[75235]:     <disk type="file" device="cdrom">
Nov 29 19:03:09 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 19:03:09 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c/disk.config"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="hda" bus="ide"/>
Nov 29 19:03:09 user nova-compute[75235]:     </disk>
Nov 29 19:03:09 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:03:09 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:09 user nova-compute[75235]:       <source dev="/dev/sdc"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <serial>a5f9108c-4497-471c-a921-47252881f848</serial>
Nov 29 19:03:09 user nova-compute[75235]:     </disk>
Nov 29 19:03:09 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:03:09 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:09 user nova-compute[75235]:       <source dev="/dev/sdf"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <serial>2f3a1872-ae40-4504-a9a2-fe8bf37cdd82</serial>
Nov 29 19:03:09 user nova-compute[75235]:     </disk>
Nov 29 19:03:09 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:03:09 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:09 user nova-compute[75235]:       <source dev="/dev/sdh"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="vdc" bus="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <serial>a7979675-b1f4-491c-83f7-075a6417de4d</serial>
Nov 29 19:03:09 user nova-compute[75235]:     </disk>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:66:1d:e8"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tap86cc49ca-67"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:4e:4f:e7"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tap2180ed4f-ef"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:1e:f7:f7"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tapa21488c6-77"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:d4:c2:1b"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tap9d300876-7a"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:27:de:c3"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tapa2ed01a1-0a"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:8c:3c:d9"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tap8bb8b3ee-5a"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:03:09 user nova-compute[75235]:       <mac address="fa:16:3e:2a:7f:a4"/>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:03:09 user nova-compute[75235]:       <target dev="tap78180abc-79"/>
Nov 29 19:03:09 user nova-compute[75235]:     </interface>
Nov 29 19:03:09 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:03:09 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c/console.log" append="off"/>
Nov 29 19:03:09 user nova-compute[75235]:     </serial>
Nov 29 19:03:09 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:03:09 user nova-compute[75235]:     <video>
Nov 29 19:03:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:03:09 user nova-compute[75235]:     </video>
Nov 29 19:03:09 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:03:09 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:03:09 user nova-compute[75235]:     </rng>
Nov 29 19:03:09 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:03:09 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:03:09 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:03:09 user nova-compute[75235]:     </memballoon>
Nov 29 19:03:09 user nova-compute[75235]:   </devices>
Nov 29 19:03:09 user nova-compute[75235]: </domain>
Nov 29 19:03:09 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ada0bd-057f-4f90-bd4e-7f677e5746e6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6608c2ee-8791-4985-a4c7-30e2c1c1b6b6]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Flushing IO for device /dev/sde {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cad14-8900-40c9-b761-ca68c4832e04]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dba37894-c106-5492-927b-2f3f77baef93', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:03:09 user nova-compute[75235]: INFO os_vif [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32')
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Deleting instance files /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5_del
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Deletion of /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5_del complete
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f70bf58-5838-410e-b0e8-cbb7fe57eb00]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86cc49ca-67, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86cc49ca-67, col_values=(('qos', UUID('6f3a6124-7198-4028-8bb7-cbd90c55c727')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86cc49ca-67, col_values=(('external_ids', {'iface-id': '86cc49ca-6749-42d2-baf3-d5612b552fb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:1d:e8', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be1b74-a7e5-4b56-a2a3-cb4db32d2cc6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Deleted allocations for instance eafeb96d-7762-4d67-b3ff-e1221296ecb5
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67')
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[56378da5-b51b-4b27-b468-913dd84ec9bc]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6839d5b-0169-54e8-8c27-ad9e9434d3ad', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260]
Nov 29 19:03:09 user nova-compute[75235]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:09 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34206296-29c8-4fdd-8582-f355e105557d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b5e49-7879-403e-833a-cb8999ada2e2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] <== disconnect_volume: return (2334ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Deleting instance files /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5_del
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Deletion of /opt/stack/data/nova/instances/151f125a-f385-48a6-8d2a-71312aa14ed5_del complete
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'numa_topology' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.objects.base [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<eafeb96d-7762-4d67-b3ff-e1221296ecb5> lazy-loaded attributes: resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2180ed4f-ef, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2180ed4f-ef, col_values=(('qos', UUID('b7fbdc1c-7a41-441f-b7df-0d903ed8f93f')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2180ed4f-ef, col_values=(('external_ids', {'iface-id': '2180ed4f-ef9b-478b-98d4-fc1191c8132f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:4f:e7', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: INFO nova.compute.manager [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Took 3.31 seconds to destroy the instance on the hypervisor.
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef')
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e496712c-26d9-5cab-b8e0-7645b4343aa4', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.neutron [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updated VIF entry in instance network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.neutron [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap62fcb2af-32", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2eff62fd-e544-4b0a-a447-7801699ba3b8 req-92caf72a-ab69-4c56-a4ac-d2b7ddb4a7c5 service nova] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa21488c6-77, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa21488c6-77, col_values=(('qos', UUID('fa489142-1f15-4e6e-a24b-a8c702b02065')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa21488c6-77, col_values=(('external_ids', {'iface-id': 'a21488c6-77a7-46f8-a4e1-4bafd95c87ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:f7:f7', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77')
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75b47589-c532-56ee-9c77-a3e15dc17e8b', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d300876-7a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d300876-7a, col_values=(('qos', UUID('324eab3f-fc58-4052-9c13-2d59a5223b07')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d300876-7a, col_values=(('external_ids', {'iface-id': '9d300876-7a9b-4756-b1a3-40118556fd87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c2:1b', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d667ab5a-02d7-4228-b369-e15e154d0864 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.501s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a')
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b882cea9-7fcb-5cef-a2df-5e6ea95d9efe', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2ed01a1-0a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2ed01a1-0a, col_values=(('qos', UUID('9a028eef-06bb-46cd-9eb8-92af54d24945')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2ed01a1-0a, col_values=(('external_ids', {'iface-id': 'a2ed01a1-0a46-453c-b542-37979837174f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:de:c3', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Took 0.57 seconds to deallocate network for instance.
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-efa96f31-33c4-4c7f-8444-65e65144b907 req-34def43f-45ad-465b-a3ac-82983a7d6ca1 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Received event network-vif-deleted-d3d47ecf-b064-4675-af30-06ec91e3f96d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:10 user nova-compute[75235]: INFO nova.compute.manager [req-efa96f31-33c4-4c7f-8444-65e65144b907 req-34def43f-45ad-465b-a3ac-82983a7d6ca1 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Neutron deleted interface d3d47ecf-b064-4675-af30-06ec91e3f96d; detaching it from the instance and deleting it from the info cache
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-efa96f31-33c4-4c7f-8444-65e65144b907 req-34def43f-45ad-465b-a3ac-82983a7d6ca1 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-efa96f31-33c4-4c7f-8444-65e65144b907 req-34def43f-45ad-465b-a3ac-82983a7d6ca1 service nova] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Detach interface failed, port_id=d3d47ecf-b064-4675-af30-06ec91e3f96d, reason: Instance 151f125a-f385-48a6-8d2a-71312aa14ed5 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a')
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1daa274e-e04a-5ecc-8831-08580a76646b', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bb8b3ee-5a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bb8b3ee-5a, col_values=(('qos', UUID('9bb3a42a-0045-4172-9316-c252127e2720')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bb8b3ee-5a, col_values=(('external_ids', {'iface-id': '8bb8b3ee-5a58-480c-b03c-87858cc2483a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:3c:d9', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a')
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '415e8691-8a96-5a24-8240-8c2e8e646bc1', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78180abc-79, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78180abc-79, col_values=(('qos', UUID('4fd0db7f-4d55-4637-89b3-eb7d640bdd7b')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78180abc-79, col_values=(('external_ids', {'iface-id': '78180abc-79e1-4b4f-bd98-3d77701f3863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:7f:a4', 'vm-uuid': '31eaaa64-f6cb-4e8a-bf81-d349cf72c34c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: INFO nova.compute.manager [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] [instance: 151f125a-f385-48a6-8d2a-71312aa14ed5] Took 0.97 seconds to detach 1 volumes for instance.
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:11 user nova-compute[75235]: WARNING nova.compute.manager [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c for instance with vm_state building and task_state spawning.
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:11 user nova-compute[75235]: WARNING nova.compute.manager [req-1d97c16f-c51b-4a08-a5d6-5666ab2de787 req-83a778c3-5d2a-4507-9d51-3245c3fb1ba1 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c for instance with vm_state building and task_state spawning.
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: INFO os_vif [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79')
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-a9b5821f-039d-4572-a934-23d0cddf831b req-c00ab302-8740-4642-93c8-b292a3d2b791 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a9b5821f-039d-4572-a934-23d0cddf831b req-c00ab302-8740-4642-93c8-b292a3d2b791 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a9b5821f-039d-4572-a934-23d0cddf831b req-c00ab302-8740-4642-93c8-b292a3d2b791 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a9b5821f-039d-4572-a934-23d0cddf831b req-c00ab302-8740-4642-93c8-b292a3d2b791 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-a9b5821f-039d-4572-a934-23d0cddf831b req-c00ab302-8740-4642-93c8-b292a3d2b791 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:11 user nova-compute[75235]: WARNING nova.compute.manager [req-a9b5821f-039d-4572-a934-23d0cddf831b req-c00ab302-8740-4642-93c8-b292a3d2b791 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 for instance with vm_state building and task_state spawning.
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] No BDM found with device name hda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] No VIF found with MAC fa:16:3e:66:1d:e8, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] No VIF found with MAC fa:16:3e:27:de:c3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:11 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Using config drive
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.volume.cinder [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Update attachment failed for attachment 3d45030c-e260-443c-b018-97949467a55b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-06c21bb1-38be-4901-bd82-5cd6188fb77d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-06c21bb1-38be-4901-bd82-5cd6188fb77d)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Failed to attach 88944f9d-f745-4dea-9ba0-21d2b4f13a2d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-06c21bb1-38be-4901-bd82-5cd6188fb77d)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Traceback (most recent call last):
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     self._do_attach(context, instance, volume, volume_api,
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     self._volume_attach(context, volume, connector, instance,
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     connection_info = volume_api.attachment_update(
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     res = method(self, ctx, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     with excutils.save_and_reraise_exception():
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     self.force_reraise()
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     raise self.value
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     return method.func(obj, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     resp = self._update('/attachments/%s' % id, body)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     return self.request(url, method, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133]     raise exceptions.from_response(resp, body)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-06c21bb1-38be-4901-bd82-5cd6188fb77d)
Nov 29 19:03:11 user nova-compute[75235]: ERROR nova.compute.manager [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] 
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.086s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server [None req-fd0905e4-32d8-4e93-abaf-b47144e05a93 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-06c21bb1-38be-4901-bd82-5cd6188fb77d)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-06c21bb1-38be-4901-bd82-5cd6188fb77d)
Nov 29 19:03:11 user nova-compute[75235]: ERROR oslo_messaging.rpc.server 
Nov 29 19:03:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.624s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:11 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Creating config drive at /opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c/disk.config
Nov 29 19:03:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqmi53wyq {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:11 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Deleted allocations for instance 151f125a-f385-48a6-8d2a-71312aa14ed5
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqmi53wyq" returned: 0 in 0.061s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a91dfbcc-ec01-4be7-9b86-93589a5ecbc6 tempest-DeleteServersTestJSON-595916133 tempest-DeleteServersTestJSON-595916133-project-member] Lock "151f125a-f385-48a6-8d2a-71312aa14ed5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.859s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:12 user nova-compute[75235]: WARNING nova.compute.manager [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 for instance with vm_state building and task_state spawning.
Nov 29 19:03:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:12 user nova-compute[75235]: WARNING nova.compute.manager [req-eb076ec7-dc43-49fd-ba67-8e04ff80622a req-2bf5f900-c398-47eb-8aea-6e64aec1bf55 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 for instance with vm_state building and task_state spawning.
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-changed-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Refreshing instance network info cache due to event network-changed-e3bc0bbb-19b7-481d-a207-158aa7d7fe78. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] Acquiring lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] Acquired lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.network.neutron [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Refreshing network info cache for port e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:13 user nova-compute[75235]: WARNING nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 for instance with vm_state building and task_state spawning.
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:13 user nova-compute[75235]: WARNING nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 for instance with vm_state building and task_state spawning.
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:13 user nova-compute[75235]: WARNING nova.compute.manager [req-2a3990d2-ead3-4698-a0e3-dafcc4bd4702 req-f0d525ee-9c5e-491e-85e7-c746676b3bc6 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 for instance with vm_state building and task_state spawning.
Nov 29 19:03:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.network.neutron [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updated VIF entry in instance network info cache for port e3bc0bbb-19b7-481d-a207-158aa7d7fe78. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG nova.network.neutron [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating instance_info_cache with network_info: [{"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-78768281-8501-4d71-8c91-12bfb0d70fcb req-d714f3b1-5ea9-4687-bf70-65c59470a08f service nova] Releasing lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:14 user nova-compute[75235]: WARNING nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc for instance with vm_state building and task_state spawning.
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:14 user nova-compute[75235]: WARNING nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc for instance with vm_state building and task_state spawning.
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:14 user nova-compute[75235]: WARNING nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e for instance with vm_state building and task_state spawning.
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:14 user nova-compute[75235]: WARNING nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e for instance with vm_state building and task_state spawning.
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:14 user nova-compute[75235]: WARNING nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 for instance with vm_state building and task_state spawning.
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:14 user nova-compute[75235]: WARNING nova.compute.manager [req-e5aa81d6-de06-4dbb-898d-42fca5acb3da req-d163ca11-94d9-4b96-83d6-bda42dd707c7 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 for instance with vm_state building and task_state spawning.
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:15 user nova-compute[75235]: WARNING nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f for instance with vm_state building and task_state spawning.
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:15 user nova-compute[75235]: WARNING nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f for instance with vm_state building and task_state spawning.
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:15 user nova-compute[75235]: WARNING nova.compute.manager [req-3ca88752-c0f9-43dd-8da1-407f1cf9de5c req-7c644067-3163-474b-8812-570711f622c5 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec for instance with vm_state building and task_state spawning.
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'flavor' on Instance uuid d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-changed-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Refreshing instance network info cache due to event network-changed-5b1fd2ee-3e0c-4951-8909-25b853d04b1c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] Acquiring lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] Acquired lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Refreshing network info cache for port 5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:03:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:16 user nova-compute[75235]: INFO nova.compute.manager [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Attaching volume 5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 to /dev/vdb
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG os_brick.utils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[253436c9-18cb-4f87-994e-5042701af37b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f5add0-a96b-4950-a296-83ab6da121ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57715b-02a0-4f2a-90a7-2a0233b726d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b155ca74-423b-4246-bf4e-a02e504d5c99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:16 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa1585-01c2-426c-995a-c7fce73462e7]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG os_brick.utils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating existing volume attachment record: c114a2a2-527e-4bdd-abb3-15f98beae65f {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:16 user nova-compute[75235]: WARNING nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 for instance with vm_state building and task_state spawning.
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:16 user nova-compute[75235]: WARNING nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 for instance with vm_state building and task_state spawning.
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:16 user nova-compute[75235]: WARNING nova.compute.manager [req-a39229e6-8acc-47b1-a507-62d8a7abf5c5 req-193e3ad9-e1b5-49be-93b7-e62453d1081c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f for instance with vm_state building and task_state spawning.
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance spawned successfully.
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "interface-d7e65309-b31e-4e11-bc9c-495c13d276bf-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "interface-d7e65309-b31e-4e11-bc9c-495c13d276bf-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'flavor' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:16 user nova-compute[75235]: INFO nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Took 17.58 seconds to spawn the instance on the hypervisor.
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updated VIF entry in instance network info cache for port 5b1fd2ee-3e0c-4951-8909-25b853d04b1c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7727770d-4664-49a9-a5fe-c1a5b296152b req-04ceb887-5b8b-4520-9a0e-a48c355f8504 service nova] Releasing lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:16 user nova-compute[75235]: INFO nova.compute.manager [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Took 67.11 seconds to build instance.
Nov 29 19:03:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49102345-5d7d-45f5-ad03-07317aa09eb7 tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.256s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'pci_requests' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.objects.base [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Object Instance<d7e65309-b31e-4e11-bc9c-495c13d276bf> lazy-loaded attributes: flavor,pci_requests {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.policy [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18f21971b2c04c03922cca2bd064cc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749fed6b75994169b86c6e7cf2fe8603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:17 user nova-compute[75235]: WARNING nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec for instance with vm_state building and task_state spawning.
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:17 user nova-compute[75235]: WARNING nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 for instance with vm_state building and task_state spawning.
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:17 user nova-compute[75235]: WARNING nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 for instance with vm_state building and task_state spawning.
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:17 user nova-compute[75235]: WARNING nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 for instance with vm_state building and task_state spawning.
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:17 user nova-compute[75235]: WARNING nova.compute.manager [req-e977a33a-778b-435a-b132-1dafd9636afe req-c33dff96-fa14-44a9-b3c4-756219133c51 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 for instance with vm_state building and task_state spawning.
Nov 29 19:03:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Successfully created port: dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:18 user nova-compute[75235]: WARNING nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f for instance with vm_state building and task_state spawning.
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:18 user nova-compute[75235]: WARNING nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a for instance with vm_state building and task_state spawning.
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:18 user nova-compute[75235]: WARNING nova.compute.manager [req-8c9394fb-0254-48d2-a5da-20d6822032e1 req-029f65b0-1fac-400c-a931-ab93141dab87 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a for instance with vm_state building and task_state spawning.
Nov 29 19:03:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Successfully updated port: dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquired lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:03:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance spawned successfully.
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:03:18 user nova-compute[75235]: INFO nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Took 19.94 seconds to spawn the instance on the hypervisor.
Nov 29 19:03:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:03:19 user nova-compute[75235]: INFO nova.compute.manager [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Took 62.84 seconds to build instance.
Nov 29 19:03:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1015e060-a964-41cf-9612-27900eb2f38f tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.942s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-changed-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Refreshing instance network info cache due to event network-changed-dfb094f0-d65f-4581-8182-206ea4107c03. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] Acquiring lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Releasing lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] Acquired lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Refreshing network info cache for port dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG os_vif [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '394acb8e-6700-5f22-a548-76587d67d796', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfb094f0-d6, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfb094f0-d6, col_values=(('qos', UUID('c7aae491-5da3-4d71-8757-ff396038701f')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfb094f0-d6, col_values=(('external_ids', {'iface-id': 'dfb094f0-d65f-4581-8182-206ea4107c03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:d2:90', 'vm-uuid': 'd7e65309-b31e-4e11-bc9c-495c13d276bf'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: INFO os_vif [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6')
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] attach device xml: <interface type="ethernet">
Nov 29 19:03:19 user nova-compute[75235]:   <mac address="fa:16:3e:d8:d2:90"/>
Nov 29 19:03:19 user nova-compute[75235]:   <model type="virtio"/>
Nov 29 19:03:19 user nova-compute[75235]:   <mtu size="1442"/>
Nov 29 19:03:19 user nova-compute[75235]:   <target dev="tapdfb094f0-d6"/>
Nov 29 19:03:19 user nova-compute[75235]: </interface>
Nov 29 19:03:19 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No BDM found with device name hda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No VIF found with MAC fa:16:3e:5d:6c:67, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.network.neutron [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updated VIF entry in instance network info cache for port dfb094f0-d65f-4581-8182-206ea4107c03. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.network.neutron [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e7f45b71-cdec-42e5-bdc1-150ca90dc2c5 req-e9f88d56-648c-40be-b1c8-9dc1978a92ca service nova] Releasing lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:03:20 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:03:20 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:03:20 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:03:20</nova:creationTime>
Nov 29 19:03:20 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:03:20 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:03:20 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:03:20 user nova-compute[75235]:   <nova:owner>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:03:20 user nova-compute[75235]:   </nova:owner>
Nov 29 19:03:20 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:03:20 user nova-compute[75235]:   <nova:ports>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:03:20 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:03:20 user nova-compute[75235]:     </nova:port>
Nov 29 19:03:20 user nova-compute[75235]:     <nova:port uuid="dfb094f0-d65f-4581-8182-206ea4107c03">
Nov 29 19:03:20 user nova-compute[75235]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 29 19:03:20 user nova-compute[75235]:     </nova:port>
Nov 29 19:03:20 user nova-compute[75235]:   </nova:ports>
Nov 29 19:03:20 user nova-compute[75235]: </nova:instance>
Nov 29 19:03:20 user nova-compute[75235]:  {{(pid=75235) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-48cf3b5e-8763-45d6-a816-54e1703ff5ee tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "interface-d7e65309-b31e-4e11-bc9c-495c13d276bf-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.613s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'flavor' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:21 user nova-compute[75235]: INFO nova.compute.manager [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Attaching volume 7f3c9307-f1f1-44c4-b432-17fc062d6a71 to /dev/vdb
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-changed-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Refreshing instance network info cache due to event network-changed-9bf5b734-6480-4406-bce5-25ed601aee83. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] Acquiring lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] Acquired lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Refreshing network info cache for port 9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG os_brick.utils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf69c41-0353-4d5a-b892-741aed7c9bea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[55731828-7961-40e9-995a-63e83620f7f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b1c288-0642-49f7-8729-83b5662711ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ce51d-c672-4537-850b-c6a4a5db649c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:21 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e631d-46d6-4654-9e9a-ffa9787abd2e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG os_brick.utils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating existing volume attachment record: 4a94565d-55a4-45b9-a74f-7d32435b34e9 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:21 user nova-compute[75235]: WARNING nova.compute.manager [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 for instance with vm_state active and task_state None.
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:21 user nova-compute[75235]: WARNING nova.compute.manager [req-c1ae157c-6a4b-4ddc-bdb0-afa0a24be337 req-8610a0b6-313e-400c-b7af-49106197ff59 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 for instance with vm_state active and task_state None.
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updated VIF entry in instance network info cache for port 9bf5b734-6480-4406-bce5-25ed601aee83. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updating instance_info_cache with network_info: [{"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-176a8808-cb56-476a-8cba-73f8ade90475 req-f278b753-f884-49f5-ac65-6ef4240cc81b service nova] Releasing lock "refresh_cache-59547806-99f2-4fa7-8f73-4ed1bf2890c1" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:23 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lazy-loading 'flavor' on Instance uuid 59547806-99f2-4fa7-8f73-4ed1bf2890c1 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:24 user nova-compute[75235]: INFO nova.compute.manager [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Attaching volume c16b84b5-e1e3-40e9-9d31-da5144569a2a to /dev/sdc
Nov 29 19:03:24 user nova-compute[75235]: DEBUG os_brick.utils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91de1d1-5dd7-445b-a24e-25a0370d8f83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c85687b-5ba3-4f65-841e-074378a3d2c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[683cbe7e-1dbc-483e-94ee-54019b23c650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fb2d24-9d2e-4c30-ab2e-525e71559d65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:24 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:03:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac370d05-877f-4422-b336-8d01866ea7ff]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG os_brick.utils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updating existing volume attachment record: 0fe45642-cfe7-4152-9092-354de0a3b764 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:03:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azNxcVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:25 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:25 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:25 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c2005-dc78-4560-802f-c5f8c9cba6ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:25 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8749ed-decc-49e7-8cc7-08cbdd4810b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8] added
Nov 29 19:03:25 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa7605-30c4-4cc2-9807-e4d7356c58af]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3300166-72a6-4654-bb0a-96889085530c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azNxcVWm {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azNxcVWm" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d222f44-80c5-4378-9f68-88f9b5768a07]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'azNxcVWm'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b6914-6fa9-4add-a049-99e1ea811890]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[180be6b3-f603-4704-8f58-d0464136833f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:25 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:25 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bc57ab-588b-444f-80ca-37894d5854f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260]
Nov 29 19:03:25 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:25 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce3182-1b9e-4b12-af16-7493e97e86d5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[35641f0e-8a47-4cbb-b2e1-ee19bc44cc2c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:25 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:25 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5f1d98-c3a7-4812-9467-a00688eb16b8]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azNxcVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26266326638393031', 'path': '/dev/sde'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266326638393031', 'path': '/dev/sde'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:26 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'flavor' on Instance uuid d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:03:26 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:26 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:03:26 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:26 user nova-compute[75235]:   <serial>5bcb424d-f91c-4c03-84ac-a4928aeb1ae8</serial>
Nov 29 19:03:26 user nova-compute[75235]: </disk>
Nov 29 19:03:26 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:03:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No VIF found with MAC fa:16:3e:c1:e1:90, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a2ac6ae-1b6a-4f35-b7ba-06ecc8206799 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.512s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:28 user nova-compute[75235]: INFO nova.compute.manager [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Detaching volume 5bcb424d-f91c-4c03-84ac-a4928aeb1ae8
Nov 29 19:03:28 user nova-compute[75235]: INFO nova.virt.block_device [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Attempting to driver detach volume 5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 from mountpoint /dev/vdb
Nov 29 19:03:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Attempting to detach device vdb from instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:03:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:28 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:28 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:03:28 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:28 user nova-compute[75235]:   <serial>5bcb424d-f91c-4c03-84ac-a4928aeb1ae8</serial>
Nov 29 19:03:28 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:03:28 user nova-compute[75235]: </disk>
Nov 29 19:03:28 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Successfully detached device vdb from instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 from the persistent domain config.
Nov 29 19:03:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:03:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:28 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:28 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:03:28 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:28 user nova-compute[75235]:   <serial>5bcb424d-f91c-4c03-84ac-a4928aeb1ae8</serial>
Nov 29 19:03:28 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:03:28 user nova-compute[75235]: </disk>
Nov 29 19:03:28 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:03:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgqRMmhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:30 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:30 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:30 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d53458-f68b-48d6-86b0-c1a64baf3601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:30 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce84bf-abe2-47b3-91d5-cab7086b8b1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71] added
Nov 29 19:03:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d574c0d2-7dff-4c32-9240-8927ab661dbe]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b49a18-bfb9-4fe1-aa80-640d19187901]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgqRMmhs {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dgqRMmhs" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2366635-4f56-44f1-bf78-ce81e88e1dc6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dgqRMmhs'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[31350778-60bc-4de1-89a2-79625e766719]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2111a8-51d6-461b-a35c-f996a2ac8e85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0aefd0-2bb2-4d40-a2a5-65d8a086ba85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260]
Nov 29 19:03:30 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38254d2-9102-43c1-8d45-877d056f50c8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd7278-461c-4e1b-8f06-2d564bf8592f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:30 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ae4ba6-f54f-45e4-ba29-2696f7b4fc50]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgqRMmhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23831343831613066', 'path': '/dev/sdi'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831343831613066', 'path': '/dev/sdi'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'flavor' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:03:31 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:31 user nova-compute[75235]:   <source dev="/dev/sdi"/>
Nov 29 19:03:31 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:31 user nova-compute[75235]:   <serial>7f3c9307-f1f1-44c4-b432-17fc062d6a71</serial>
Nov 29 19:03:31 user nova-compute[75235]: </disk>
Nov 29 19:03:31 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-changed-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Refreshing instance network info cache due to event network-changed-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] Acquiring lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] Acquired lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:31 user nova-compute[75235]: DEBUG nova.network.neutron [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Refreshing network info cache for port 0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lazy-loading 'flavor' on Instance uuid 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No BDM found with device name hda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] No VIF found with MAC fa:16:3e:5d:6c:67, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-651765e5-cc2c-4f29-aa27-afe82db73fbd tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.310s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:32 user nova-compute[75235]: INFO nova.compute.manager [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Attaching volume 6e17e66c-52d7-4362-a049-055bb5540699 to /dev/vdb
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.network.neutron [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updated VIF entry in instance network info cache for port 0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.network.neutron [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updating instance_info_cache with network_info: [{"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-15b2aa1a-751f-4ced-aa85-ae388ac96132 req-6b4a4dd4-25d0-439a-8d66-e80c8cc2dade service nova] Releasing lock "refresh_cache-0f6193ce-63f6-4a8a-a527-c2fd41cc178b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG os_brick.utils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b414c643-48eb-4903-a072-b8276b4ebc27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f112a1-9536-4b48-a7db-402399287529]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c841c85-f540-4663-9589-29756e18f5b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f07ce-3b29-4b4d-9900-aef3939d7af2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:03:32 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:03:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e865a8-c99e-4cdd-85ef-32a30727cae0]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG os_brick.utils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:32 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updating existing volume attachment record: 62c097d1-9ec9-404a-ac77-adb18818565f {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbFVMINg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:33 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:33 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:33 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1a7a96-9a5e-44dc-8497-fcd53f14aac7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:33 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1127f25f-e060-4473-a52b-3ce95c0f2cff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a] added
Nov 29 19:03:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[349cf843-5e3a-4c03-8141-a68f2c05f071]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3113add9-1aba-4376-a424-0bc398599f28]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbFVMINg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbFVMINg" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d4a0f-3047-4560-a6f0-956a06b85721]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wbFVMINg'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[25710668-1cf5-4013-9f56-afa8c689a38d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[65decc37-9177-4756-a2f8-772d885cb630]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e6c91a-2946-420c-8cba-4e1df807fe52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260]
Nov 29 19:03:33 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7536253-3dd5-4a1e-92fb-95636b7bce57]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[73539590-2e6e-46e9-9c9e-65b96a086c7f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:33 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd7911-56e5-4d65-9c8c-1c95bc791171]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbFVMINg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:34 user nova-compute[75235]: INFO nova.compute.manager [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Detaching volume 7f3c9307-f1f1-44c4-b432-17fc062d6a71
Nov 29 19:03:34 user nova-compute[75235]: INFO nova.virt.block_device [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Attempting to driver detach volume 7f3c9307-f1f1-44c4-b432-17fc062d6a71 from mountpoint /dev/vdb
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Attempting to detach device vdb from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:34 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:34 user nova-compute[75235]:   <source dev="/dev/sdi"/>
Nov 29 19:03:34 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:34 user nova-compute[75235]:   <serial>7f3c9307-f1f1-44c4-b432-17fc062d6a71</serial>
Nov 29 19:03:34 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 19:03:34 user nova-compute[75235]: </disk>
Nov 29 19:03:34 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully detached device vdb from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the persistent domain config.
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:34 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:34 user nova-compute[75235]:   <source dev="/dev/sdi"/>
Nov 29 19:03:34 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:34 user nova-compute[75235]:   <serial>7f3c9307-f1f1-44c4-b432-17fc062d6a71</serial>
Nov 29 19:03:34 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 19:03:34 user nova-compute[75235]: </disk>
Nov 29 19:03:34 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23261623465613766', 'path': '/dev/sdj'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261623465613766', 'path': '/dev/sdj'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lazy-loading 'flavor' on Instance uuid 59547806-99f2-4fa7-8f73-4ed1bf2890c1 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:03:34 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:34 user nova-compute[75235]:   <source dev="/dev/sdj"/>
Nov 29 19:03:34 user nova-compute[75235]:   <target dev="sdc" bus="scsi"/>
Nov 29 19:03:34 user nova-compute[75235]:   <serial>c16b84b5-e1e3-40e9-9d31-da5144569a2a</serial>
Nov 29 19:03:34 user nova-compute[75235]:   <address type="drive" controller="0" unit="2"/>
Nov 29 19:03:34 user nova-compute[75235]: </disk>
Nov 29 19:03:34 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:03:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:03:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No BDM found with device name sda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] No VIF found with MAC fa:16:3e:ad:1a:ec, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1213f0a3-4a20-4edd-83cd-4602017536fc tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.411s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:37 user nova-compute[75235]: INFO nova.compute.manager [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Detaching volume c16b84b5-e1e3-40e9-9d31-da5144569a2a
Nov 29 19:03:37 user nova-compute[75235]: INFO nova.virt.block_device [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Attempting to driver detach volume c16b84b5-e1e3-40e9-9d31-da5144569a2a from mountpoint /dev/sdc
Nov 29 19:03:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Attempting to detach device sdc from instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:03:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:37 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:37 user nova-compute[75235]:   <source dev="/dev/sdj"/>
Nov 29 19:03:37 user nova-compute[75235]:   <target dev="sdc" bus="scsi"/>
Nov 29 19:03:37 user nova-compute[75235]:   <serial>c16b84b5-e1e3-40e9-9d31-da5144569a2a</serial>
Nov 29 19:03:37 user nova-compute[75235]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 19:03:37 user nova-compute[75235]: </disk>
Nov 29 19:03:37 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Successfully detached device sdc from instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 from the persistent domain config.
Nov 29 19:03:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:03:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:37 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:37 user nova-compute[75235]:   <source dev="/dev/sdj"/>
Nov 29 19:03:37 user nova-compute[75235]:   <target dev="sdc" bus="scsi"/>
Nov 29 19:03:37 user nova-compute[75235]:   <serial>c16b84b5-e1e3-40e9-9d31-da5144569a2a</serial>
Nov 29 19:03:37 user nova-compute[75235]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 19:03:37 user nova-compute[75235]: </disk>
Nov 29 19:03:37 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:03:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRNpfvhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:42 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30b5d2c-f67e-4e8d-bf50-1b982709d279]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:03:42 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[57174c7b-7045-4e28-b77a-cb03ba57c70d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699] added
Nov 29 19:03:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f1aa1f-3e49-4968-ae77-eed34af15a6c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee249b79-5e10-4ee3-a742-93c56f61b38b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRNpfvhK {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRNpfvhK" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec903fcb-fbd2-41b4-8dea-3ad7b5af8511]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRNpfvhK'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734f50f-1548-4c4a-831f-e399f7a0959d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0469a5f0-290a-4035-8b93-66e40e161045]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de15f85c-b672-4551-9ada-8729187f5e90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260]
Nov 29 19:03:43 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5682242-383d-4fbe-b829-d5be6dea89d3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:43 user nova-compute[75235]: INFO nova.compute.manager [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Terminating instance
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e2f3c5-52be-48fd-88bf-a26525ef277b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:43 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG nova.compute.manager [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d346f-bac0-49d4-8e3d-f876c7a9e313]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRNpfvhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-6716d36c-d555-48d6-b4f8-de1fa342a693 req-4879a2d6-6fb5-4c81-a171-1685ed972b70 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-vif-unplugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6716d36c-d555-48d6-b4f8-de1fa342a693 req-4879a2d6-6fb5-4c81-a171-1685ed972b70 service nova] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6716d36c-d555-48d6-b4f8-de1fa342a693 req-4879a2d6-6fb5-4c81-a171-1685ed972b70 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6716d36c-d555-48d6-b4f8-de1fa342a693 req-4879a2d6-6fb5-4c81-a171-1685ed972b70 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-6716d36c-d555-48d6-b4f8-de1fa342a693 req-4879a2d6-6fb5-4c81-a171-1685ed972b70 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] No waiting events found dispatching network-vif-unplugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-6716d36c-d555-48d6-b4f8-de1fa342a693 req-4879a2d6-6fb5-4c81-a171-1685ed972b70 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-vif-unplugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Instance destroyed successfully.
Nov 29 19:03:43 user nova-compute[75235]: DEBUG nova.objects.instance [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lazy-loading 'resources' on Instance uuid bc9d2f79-2f68-4818-9c92-a1c349bc13c2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1826821391',display_name='tempest-VolumesNegativeTest-instance-1826821391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1826821391',id=10,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:02:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f2b53592e324e408146b428821ac2d2',ramdisk_id='',reservation_id='r-3fz23rlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1321064919',owner_user_name='tempest-VolumesNegativeTest-1321064919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:02:02Z,user_data=None,user_id='f2cf5f5fec284ca5acb4b2a23ccbdf3c',uuid=bc9d2f79-2f68-4818-9c92-a1c349bc13c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Converting VIF {"id": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "address": "fa:16:3e:d1:6c:82", "network": {"id": "31aac522-840c-4786-b365-4d6bd9e28f0f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "80b3352fffc44fa490721284ad4b9758", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c02b1bb-d4", "ovs_interfaceid": "4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG os_vif [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c02b1bb-d4, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=275aee57-48df-4418-bdf6-f1f8f1f16576) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:44 user nova-compute[75235]: INFO os_vif [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6c:82,bridge_name='br-int',has_traffic_filtering=True,id=4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37,network=Network(31aac522-840c-4786-b365-4d6bd9e28f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c02b1bb-d4')
Nov 29 19:03:44 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Deleting instance files /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2_del
Nov 29 19:03:44 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Deletion of /opt/stack/data/nova/instances/bc9d2f79-2f68-4818-9c92-a1c349bc13c2_del complete
Nov 29 19:03:44 user nova-compute[75235]: INFO nova.compute.manager [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 19:03:44 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23736383533336262', 'path': '/dev/sdk'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736383533336262', 'path': '/dev/sdk'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lazy-loading 'flavor' on Instance uuid 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 19:03:44 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:44 user nova-compute[75235]:   <source dev="/dev/sdk"/>
Nov 29 19:03:44 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:44 user nova-compute[75235]:   <serial>6e17e66c-52d7-4362-a049-055bb5540699</serial>
Nov 29 19:03:44 user nova-compute[75235]: </disk>
Nov 29 19:03:44 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:44 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Took 0.59 seconds to deallocate network for instance.
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] No VIF found with MAC fa:16:3e:67:b8:9d, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ca300c46-a7a9-4c34-b3ad-6e6d9862b171 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.466s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:45 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Deleted allocations for instance bc9d2f79-2f68-4818-9c92-a1c349bc13c2
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-86d7d287-3661-4ab7-898a-4bf849bf01d4 tempest-VolumesNegativeTest-1321064919 tempest-VolumesNegativeTest-1321064919-project-member] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] volume_snapshot_create: create_info: {'snapshot_id': '25df6b42-4d50-4a30-a372-de10c9a31291', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75235) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] snap xml: <domainsnapshot>
Nov 29 19:03:45 user nova-compute[75235]:   <disks>
Nov 29 19:03:45 user nova-compute[75235]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 29 19:03:45 user nova-compute[75235]:       <source file="/dev/new_file"/>
Nov 29 19:03:45 user nova-compute[75235]:     </disk>
Nov 29 19:03:45 user nova-compute[75235]:     <disk name="vda" snapshot="no"/>
Nov 29 19:03:45 user nova-compute[75235]:   </disks>
Nov 29 19:03:45 user nova-compute[75235]: </domainsnapshot>
Nov 29 19:03:45 user nova-compute[75235]:  {{(pid=75235) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.objects.instance [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] Lazy-loading 'system_metadata' on Instance uuid 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     rv = execute(f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     six.reraise(c, e, tb)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     raise value
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     rv = meth(*args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     self._volume_snapshot_create(context, instance, guest,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     rv = execute(f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     six.reraise(c, e, tb)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     raise value
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     rv = meth(*args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] 
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c925517e-bb60-4765-9d10-15dfab3a9770 tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] volume_snapshot_delete: delete_info: {'volume_id': '6e17e66c-52d7-4362-a049-055bb5540699'} {{(pid=75235) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [None req-c925517e-bb60-4765-9d10-15dfab3a9770 tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b]     if delete_info['type'] != 'qcow2':
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] KeyError: 'type'
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] 
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] Acquiring lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] Lock "bc9d2f79-2f68-4818-9c92-a1c349bc13c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] No waiting events found dispatching network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:45 user nova-compute[75235]: WARNING nova.compute.manager [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received unexpected event network-vif-plugged-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 for instance with vm_state deleted and task_state None.
Nov 29 19:03:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-45d9a38b-2f48-41b1-8afb-4b18d3c08795 req-83ae8cfe-c79e-4323-9676-2304686d4ba5 service nova] [instance: bc9d2f79-2f68-4818-9c92-a1c349bc13c2] Received event network-vif-deleted-4c02b1bb-d4f1-41c4-b3f4-108b18a1bd37 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [None req-c925517e-bb60-4765-9d10-15dfab3a9770 tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6da2fdc3-0a17-4efc-88bd-06e67f58f7c8)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server [None req-c925517e-bb60-4765-9d10-15dfab3a9770 tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] Exception during message handling: KeyError: 'type'
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 25df6b42-4d50-4a30-a372-de10c9a31291 could not be found.
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 25df6b42-4d50-4a30-a372-de10c9a31291 could not be found. (HTTP 404) (Request-ID: req-d144af64-65cf-467a-840c-be0fdf001db3)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 25df6b42-4d50-4a30-a372-de10c9a31291 could not be found.
Nov 29 19:03:45 user nova-compute[75235]: ERROR nova.virt.libvirt.driver 
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server [None req-95fb23c9-7b1e-4df4-8f72-e71d30a786dd tempest-VolumesAssistedSnapshotsTest-107303574 tempest-VolumesAssistedSnapshotsTest-107303574-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 19:03:45 user nova-compute[75235]: ERROR oslo_messaging.rpc.server 
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:45 user nova-compute[75235]: INFO nova.compute.manager [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Detaching volume 6e17e66c-52d7-4362-a049-055bb5540699
Nov 29 19:03:46 user nova-compute[75235]: INFO nova.virt.block_device [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Attempting to driver detach volume 6e17e66c-52d7-4362-a049-055bb5540699 from mountpoint /dev/vdb
Nov 29 19:03:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Attempting to detach device vdb from instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:03:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:46 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:46 user nova-compute[75235]:   <source dev="/dev/sdk"/>
Nov 29 19:03:46 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:46 user nova-compute[75235]:   <serial>6e17e66c-52d7-4362-a049-055bb5540699</serial>
Nov 29 19:03:46 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:03:46 user nova-compute[75235]: </disk>
Nov 29 19:03:46 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Successfully detached device vdb from instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b from the persistent domain config.
Nov 29 19:03:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:03:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 19:03:46 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:03:46 user nova-compute[75235]:   <source dev="/dev/sdk"/>
Nov 29 19:03:46 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:03:46 user nova-compute[75235]:   <serial>6e17e66c-52d7-4362-a049-055bb5540699</serial>
Nov 29 19:03:46 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:03:46 user nova-compute[75235]: </disk>
Nov 29 19:03:46 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 is timed out.
Nov 29 19:03:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Successfully detached device vdb from instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 from the live domain config.
Nov 29 19:03:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azNxcVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:49 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[df33e1bd-559b-4697-a053-f6a4e419e0fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:03:49 user nova-compute[75235]: No targets found.
Nov 29 19:03:49 user nova-compute[75235]: iSNS:
Nov 29 19:03:49 user nova-compute[75235]: No targets found.
Nov 29 19:03:49 user nova-compute[75235]: STATIC:
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:03:49 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:49 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:49 user nova-compute[75235]: FIRMWARE:
Nov 29 19:03:49 user nova-compute[75235]: No targets found.
Nov 29 19:03:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:03:49 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:03:49 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba3e425-f624-4a77-9fca-b0d9fd09de1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[32373f14-aeab-4991-af8c-8c1720645b1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:49 user nova-compute[75235]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 (non-flash)
Nov 29 19:03:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565059f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8'): ({'sde'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Removing single pathed devices sde {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc7769-c8b9-4af6-b76b-757465ec7446]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fa667b-787c-46af-b740-b37a01a7a1ff]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Flushing IO for device /dev/sde {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716409b-3573-4e56-bb96-e733a1f694b2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a695da0f-aeb7-4910-a25f-3f4b3b561ebb]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da8d77-f359-4e58-a342-f96fa4357af3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37d1c2a-edb9-47c1-9d7a-c377ffc48364]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260]
Nov 29 19:03:49 user nova-compute[75235]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bcb424d-f91c-4c03-84ac-a4928aeb1ae8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220fbde-3528-48a9-92d2-bc776390e01d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] <== disconnect_volume: return (375ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'flavor' on Instance uuid d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:03:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7198MB free_disk=25.50159454345703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2ec987e4-3e6e-4c1f-8e6c-ba6aaea310ff tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.237s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance aa2da6c4-f2d2-4598-9113-122b3ca34133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d7e65309-b31e-4e11-bc9c-495c13d276bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:03:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:03:51 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:03:51 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:03:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:03:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:03:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf is timed out.
Nov 29 19:03:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully detached device vdb from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the live domain config.
Nov 29 19:03:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dgqRMmhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:54 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b20d6-54b1-49a5-8f20-d5b4d15b04a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:03:54 user nova-compute[75235]: No targets found.
Nov 29 19:03:54 user nova-compute[75235]: iSNS:
Nov 29 19:03:54 user nova-compute[75235]: No targets found.
Nov 29 19:03:54 user nova-compute[75235]: STATIC:
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:03:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:54 user nova-compute[75235]: FIRMWARE:
Nov 29 19:03:54 user nova-compute[75235]: No targets found.
Nov 29 19:03:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:03:54 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:03:54 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c00a27-d78d-4b7e-9bd2-04127243daa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f279c31c-e51d-4796-9407-a4f28960e185]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:55 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56501ecdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71'): ({'sdi'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Removing single pathed devices sdi {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[552e6bd2-0cb4-4dc2-8d42-051a3f900752]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ed866d-83fa-456a-91fa-0f5b6ddd964c]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Flushing IO for device /dev/sdi {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd60d63b-73e1-4c03-b84c-4f7a5ceed918]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e35fef7-e77d-4a01-a98b-5aa14c367fc7]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] SCSI volumes sdi have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7935e920-251d-48a1-bbf6-afc75da39aa3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a9226-7f78-4857-81ad-26c4674be57f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260]
Nov 29 19:03:55 user nova-compute[75235]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f3c9307-f1f1-44c4-b432-17fc062d6a71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d612f13-3245-4c2c-b641-d52464184ccd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] <== disconnect_volume: return (331ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.objects.instance [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'flavor' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-044d6a9a-58ff-414a-9bd1-2603ba17937a tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "interface-d7e65309-b31e-4e11-bc9c-495c13d276bf-dfb094f0-d65f-4581-8182-206ea4107c03" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "interface-d7e65309-b31e-4e11-bc9c-495c13d276bf-dfb094f0-d65f-4581-8182-206ea4107c03" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'flavor' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface> {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface> {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Attempting to detach device tapdfb094f0-d6 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] detach device xml: <interface type="ethernet">
Nov 29 19:03:56 user nova-compute[75235]:   <mac address="fa:16:3e:d8:d2:90"/>
Nov 29 19:03:56 user nova-compute[75235]:   <model type="virtio"/>
Nov 29 19:03:56 user nova-compute[75235]:   <mtu size="1442"/>
Nov 29 19:03:56 user nova-compute[75235]:   <target dev="tapdfb094f0-d6"/>
Nov 29 19:03:56 user nova-compute[75235]: </interface>
Nov 29 19:03:56 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface> {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 19:03:56 user nova-compute[75235]:   <name>instance-00000007</name>
Nov 29 19:03:56 user nova-compute[75235]:   <uuid>d7e65309-b31e-4e11-bc9c-495c13d276bf</uuid>
Nov 29 19:03:56 user nova-compute[75235]:   <metadata>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:03:56 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:03:56 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:03:56 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:03:20</nova:creationTime>
Nov 29 19:03:56 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:03:56 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:03:56 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:03:56 user nova-compute[75235]:   <nova:owner>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:03:56 user nova-compute[75235]:   </nova:owner>
Nov 29 19:03:56 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:03:56 user nova-compute[75235]:   <nova:ports>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:03:56 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:03:56 user nova-compute[75235]:     </nova:port>
Nov 29 19:03:56 user nova-compute[75235]:     <nova:port uuid="dfb094f0-d65f-4581-8182-206ea4107c03">
Nov 29 19:03:56 user nova-compute[75235]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 29 19:03:56 user nova-compute[75235]:     </nova:port>
Nov 29 19:03:56 user nova-compute[75235]:   </nova:ports>
Nov 29 19:03:56 user nova-compute[75235]: </nova:instance>
Nov 29 19:03:56 user nova-compute[75235]:   </metadata>
Nov 29 19:03:56 user nova-compute[75235]:   <memory unit='KiB'>524288</memory>
Nov 29 19:03:56 user nova-compute[75235]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 19:03:56 user nova-compute[75235]:   <vcpu placement='static'>1</vcpu>
Nov 29 19:03:56 user nova-compute[75235]:   <resource>
Nov 29 19:03:56 user nova-compute[75235]:     <partition>/machine</partition>
Nov 29 19:03:56 user nova-compute[75235]:   </resource>
Nov 29 19:03:56 user nova-compute[75235]:   <sysinfo type='smbios'>
Nov 29 19:03:56 user nova-compute[75235]:     <system>
Nov 29 19:03:56 user nova-compute[75235]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 19:03:56 user nova-compute[75235]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 19:03:56 user nova-compute[75235]:       <entry name='version'>0.0.0</entry>
Nov 29 19:03:56 user nova-compute[75235]:       <entry name='serial'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:03:56 user nova-compute[75235]:       <entry name='uuid'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:03:56 user nova-compute[75235]:       <entry name='family'>Virtual Machine</entry>
Nov 29 19:03:56 user nova-compute[75235]:     </system>
Nov 29 19:03:56 user nova-compute[75235]:   </sysinfo>
Nov 29 19:03:56 user nova-compute[75235]:   <os>
Nov 29 19:03:56 user nova-compute[75235]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 19:03:56 user nova-compute[75235]:     <boot dev='hd'/>
Nov 29 19:03:56 user nova-compute[75235]:     <smbios mode='sysinfo'/>
Nov 29 19:03:56 user nova-compute[75235]:   </os>
Nov 29 19:03:56 user nova-compute[75235]:   <features>
Nov 29 19:03:56 user nova-compute[75235]:     <acpi/>
Nov 29 19:03:56 user nova-compute[75235]:     <apic/>
Nov 29 19:03:56 user nova-compute[75235]:     <vmcoreinfo state='on'/>
Nov 29 19:03:56 user nova-compute[75235]:   </features>
Nov 29 19:03:56 user nova-compute[75235]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 19:03:56 user nova-compute[75235]:     <model fallback='forbid'>Nehalem</model>
Nov 29 19:03:56 user nova-compute[75235]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 19:03:56 user nova-compute[75235]:     <feature policy='require' name='vme'/>
Nov 29 19:03:56 user nova-compute[75235]:     <feature policy='require' name='x2apic'/>
Nov 29 19:03:56 user nova-compute[75235]:     <feature policy='require' name='hypervisor'/>
Nov 29 19:03:56 user nova-compute[75235]:   </cpu>
Nov 29 19:03:56 user nova-compute[75235]:   <clock offset='utc'>
Nov 29 19:03:56 user nova-compute[75235]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 19:03:56 user nova-compute[75235]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 19:03:56 user nova-compute[75235]:     <timer name='hpet' present='no'/>
Nov 29 19:03:56 user nova-compute[75235]:   </clock>
Nov 29 19:03:56 user nova-compute[75235]:   <on_poweroff>destroy</on_poweroff>
Nov 29 19:03:56 user nova-compute[75235]:   <on_reboot>restart</on_reboot>
Nov 29 19:03:56 user nova-compute[75235]:   <on_crash>destroy</on_crash>
Nov 29 19:03:56 user nova-compute[75235]:   <devices>
Nov 29 19:03:56 user nova-compute[75235]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 19:03:56 user nova-compute[75235]:     <disk type='file' device='disk'>
Nov 29 19:03:56 user nova-compute[75235]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 19:03:56 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk' index='2'/>
Nov 29 19:03:56 user nova-compute[75235]:       <backingStore type='file' index='3'>
Nov 29 19:03:56 user nova-compute[75235]:         <format type='raw'/>
Nov 29 19:03:56 user nova-compute[75235]:         <source file='/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0'/>
Nov 29 19:03:56 user nova-compute[75235]:         <backingStore/>
Nov 29 19:03:56 user nova-compute[75235]:       </backingStore>
Nov 29 19:03:56 user nova-compute[75235]:       <target dev='vda' bus='virtio'/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='virtio-disk0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </disk>
Nov 29 19:03:56 user nova-compute[75235]:     <disk type='file' device='cdrom'>
Nov 29 19:03:56 user nova-compute[75235]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 19:03:56 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config' index='1'/>
Nov 29 19:03:56 user nova-compute[75235]:       <backingStore/>
Nov 29 19:03:56 user nova-compute[75235]:       <target dev='hda' bus='ide'/>
Nov 29 19:03:56 user nova-compute[75235]:       <readonly/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='ide0-0-0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </disk>
Nov 29 19:03:56 user nova-compute[75235]:     <controller type='usb' index='0' model='none'>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='usb'/>
Nov 29 19:03:56 user nova-compute[75235]:     </controller>
Nov 29 19:03:56 user nova-compute[75235]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='pci.0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </controller>
Nov 29 19:03:56 user nova-compute[75235]:     <controller type='ide' index='0'>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='ide'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 19:03:56 user nova-compute[75235]:     </controller>
Nov 29 19:03:56 user nova-compute[75235]:     <interface type='ethernet'>
Nov 29 19:03:56 user nova-compute[75235]:       <mac address='fa:16:3e:5d:6c:67'/>
Nov 29 19:03:56 user nova-compute[75235]:       <target dev='tap5b1fd2ee-3e'/>
Nov 29 19:03:56 user nova-compute[75235]:       <model type='virtio'/>
Nov 29 19:03:56 user nova-compute[75235]:       <mtu size='1442'/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='net0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </interface>
Nov 29 19:03:56 user nova-compute[75235]:     <interface type='ethernet'>
Nov 29 19:03:56 user nova-compute[75235]:       <mac address='fa:16:3e:d8:d2:90'/>
Nov 29 19:03:56 user nova-compute[75235]:       <target dev='tapdfb094f0-d6'/>
Nov 29 19:03:56 user nova-compute[75235]:       <model type='virtio'/>
Nov 29 19:03:56 user nova-compute[75235]:       <mtu size='1442'/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='net1'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </interface>
Nov 29 19:03:56 user nova-compute[75235]:     <serial type='pty'>
Nov 29 19:03:56 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:03:56 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:03:56 user nova-compute[75235]:       <target type='isa-serial' port='0'>
Nov 29 19:03:56 user nova-compute[75235]:         <model name='isa-serial'/>
Nov 29 19:03:56 user nova-compute[75235]:       </target>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </serial>
Nov 29 19:03:56 user nova-compute[75235]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 19:03:56 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:03:56 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:03:56 user nova-compute[75235]:       <target type='serial' port='0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </console>
Nov 29 19:03:56 user nova-compute[75235]:     <input type='mouse' bus='ps2'>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='input0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </input>
Nov 29 19:03:56 user nova-compute[75235]:     <input type='keyboard' bus='ps2'>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='input1'/>
Nov 29 19:03:56 user nova-compute[75235]:     </input>
Nov 29 19:03:56 user nova-compute[75235]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 19:03:56 user nova-compute[75235]:       <listen type='address' address='0.0.0.0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </graphics>
Nov 29 19:03:56 user nova-compute[75235]:     <audio id='1' type='none'/>
Nov 29 19:03:56 user nova-compute[75235]:     <video>
Nov 29 19:03:56 user nova-compute[75235]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='video0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </video>
Nov 29 19:03:56 user nova-compute[75235]:     <memballoon model='virtio'>
Nov 29 19:03:56 user nova-compute[75235]:       <stats period='10'/>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='balloon0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </memballoon>
Nov 29 19:03:56 user nova-compute[75235]:     <rng model='virtio'>
Nov 29 19:03:56 user nova-compute[75235]:       <backend model='random'>/dev/urandom</backend>
Nov 29 19:03:56 user nova-compute[75235]:       <alias name='rng0'/>
Nov 29 19:03:56 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 19:03:56 user nova-compute[75235]:     </rng>
Nov 29 19:03:56 user nova-compute[75235]:   </devices>
Nov 29 19:03:56 user nova-compute[75235]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 19:03:56 user nova-compute[75235]:     <label>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</label>
Nov 29 19:03:56 user nova-compute[75235]:     <imagelabel>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</imagelabel>
Nov 29 19:03:56 user nova-compute[75235]:   </seclabel>
Nov 29 19:03:56 user nova-compute[75235]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 19:03:56 user nova-compute[75235]:     <label>+64055:+108</label>
Nov 29 19:03:56 user nova-compute[75235]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 19:03:56 user nova-compute[75235]:   </seclabel>
Nov 29 19:03:56 user nova-compute[75235]: </domain>
Nov 29 19:03:56 user nova-compute[75235]:  {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 19:03:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully detached device tapdfb094f0-d6 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the persistent domain config.
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] (1/8): Attempting to detach device tapdfb094f0-d6 with device alias net1 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:03:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] detach device xml: <interface type="ethernet">
Nov 29 19:03:56 user nova-compute[75235]:   <mac address="fa:16:3e:d8:d2:90"/>
Nov 29 19:03:56 user nova-compute[75235]:   <model type="virtio"/>
Nov 29 19:03:56 user nova-compute[75235]:   <mtu size="1442"/>
Nov 29 19:03:56 user nova-compute[75235]:   <target dev="tapdfb094f0-d6"/>
Nov 29 19:03:56 user nova-compute[75235]: </interface>
Nov 29 19:03:56 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Start waiting for the detach event from libvirt for device tapdfb094f0-d6 with device alias net1 for instance d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-d07a9177-5a66-4c7d-a6f2-5c3cfc35c320 req-d047f770-fb95-451a-8481-7e24170774f8 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-unplugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d07a9177-5a66-4c7d-a6f2-5c3cfc35c320 req-d047f770-fb95-451a-8481-7e24170774f8 service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d07a9177-5a66-4c7d-a6f2-5c3cfc35c320 req-d047f770-fb95-451a-8481-7e24170774f8 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d07a9177-5a66-4c7d-a6f2-5c3cfc35c320 req-d047f770-fb95-451a-8481-7e24170774f8 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-d07a9177-5a66-4c7d-a6f2-5c3cfc35c320 req-d047f770-fb95-451a-8481-7e24170774f8 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-unplugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:57 user nova-compute[75235]: WARNING nova.compute.manager [req-d07a9177-5a66-4c7d-a6f2-5c3cfc35c320 req-d047f770-fb95-451a-8481-7e24170774f8 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-unplugged-dfb094f0-d65f-4581-8182-206ea4107c03 for instance with vm_state active and task_state None.
Nov 29 19:03:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 is timed out.
Nov 29 19:03:57 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Successfully detached device sdc from instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1 from the live domain config.
Nov 29 19:03:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbFVMINg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:03:57 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9b149b-609b-44e2-8487-9a39272a1996]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:03:57 user nova-compute[75235]: No targets found.
Nov 29 19:03:57 user nova-compute[75235]: iSNS:
Nov 29 19:03:57 user nova-compute[75235]: No targets found.
Nov 29 19:03:57 user nova-compute[75235]: STATIC:
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:03:57 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:03:57 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:03:57 user nova-compute[75235]: FIRMWARE:
Nov 29 19:03:57 user nova-compute[75235]: No targets found.
Nov 29 19:03:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:03:57 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:03:57 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac4f79-8c18-4407-8780-1bb779e84638]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.095s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7323da7e-557e-443e-861f-5404681e44ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:03:57 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:03:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5650517b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a'): ({'sdj'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Removing single pathed devices sdj {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f052ee5b-bfb2-4949-be95-f46b1b16ff92]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1a63a-2f80-4e12-b3c5-e37dfe5495af]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Flushing IO for device /dev/sdj {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34ad1b-37f6-4c1e-8649-074652847fd7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.050s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e6a08d-e31d-4b3f-a41a-37ecdefca276]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] SCSI volumes sdj have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d588523f-5eec-4517-989d-b62f1c1e80ba]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ba98c-0163-4a46-8116-45b985672b0c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260]
Nov 29 19:03:58 user nova-compute[75235]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a, portal: 172.16.0.220,3260] successful.
Nov 29 19:03:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c16b84b5-e1e3-40e9-9d31-da5144569a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44f128-5ae3-4cc1-9c72-380210410590]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] <== disconnect_volume: return (494ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG nova.objects.instance [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lazy-loading 'flavor' on Instance uuid 59547806-99f2-4fa7-8f73-4ed1bf2890c1 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:03:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-227911e4-a520-4f6a-aeb6-63183121500d tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-6928953f-2840-4697-bda7-5e011feb998c req-b1f24471-d7fe-4e05-8267-a0368e8b3d9e service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6928953f-2840-4697-bda7-5e011feb998c req-b1f24471-d7fe-4e05-8267-a0368e8b3d9e service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6928953f-2840-4697-bda7-5e011feb998c req-b1f24471-d7fe-4e05-8267-a0368e8b3d9e service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6928953f-2840-4697-bda7-5e011feb998c req-b1f24471-d7fe-4e05-8267-a0368e8b3d9e service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-6928953f-2840-4697-bda7-5e011feb998c req-b1f24471-d7fe-4e05-8267-a0368e8b3d9e service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:03:59 user nova-compute[75235]: WARNING nova.compute.manager [req-6928953f-2840-4697-bda7-5e011feb998c req-b1f24471-d7fe-4e05-8267-a0368e8b3d9e service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-plugged-dfb094f0-d65f-4581-8182-206ea4107c03 for instance with vm_state active and task_state None.
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:03:59 user nova-compute[75235]: INFO nova.compute.manager [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Terminating instance
Nov 29 19:03:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:03:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Instance destroyed successfully.
Nov 29 19:04:00 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lazy-loading 'resources' on Instance uuid 59547806-99f2-4fa7-8f73-4ed1bf2890c1 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-622468875',display_name='tempest-AttachSCSIVolumeTestJSON-server-622468875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-622468875',id=8,image_ref='31e26ebd-cc92-4474-aace-2d4d393bcc89',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGhuCjeyKIqzN8mwkbU2xnRiGs8x3HGRdaBOSBhNfsWX6gLPshosO9DLyFgyOM0Q0QSXJWcsOFNpvISVNhDt0KAhKHFlh4jdYc6TAtQz3nHTe1SbkA4B5ULhVKpiVyaeg==',key_name='tempest-keypair-211432928',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f46132496c2942c7bbe25a049fa21b4a',ramdisk_id='',reservation_id='r-0uzfha7s',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='31e26ebd-cc92-4474-aace-2d4d393bcc89',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-300747578',owner_user_name='tempest-AttachSCSIVolumeTestJSON-300747578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e5eb354d2a4fde953ac63aa8573d70',uuid=59547806-99f2-4fa7-8f73-4ed1bf2890c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Converting VIF {"id": "9bf5b734-6480-4406-bce5-25ed601aee83", "address": "fa:16:3e:ad:1a:ec", "network": {"id": "d315d92d-c755-4cfe-8560-5a75125e94d3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1693725944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f46132496c2942c7bbe25a049fa21b4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf5b734-64", "ovs_interfaceid": "9bf5b734-6480-4406-bce5-25ed601aee83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG os_vif [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bf5b734-64, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca6f9547-4520-469e-8541-35e2ad31f8f5) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:00 user nova-compute[75235]: INFO os_vif [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:1a:ec,bridge_name='br-int',has_traffic_filtering=True,id=9bf5b734-6480-4406-bce5-25ed601aee83,network=Network(d315d92d-c755-4cfe-8560-5a75125e94d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf5b734-64')
Nov 29 19:04:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Deleting instance files /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1_del
Nov 29 19:04:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Deletion of /opt/stack/data/nova/instances/59547806-99f2-4fa7-8f73-4ed1bf2890c1_del complete
Nov 29 19:04:00 user nova-compute[75235]: INFO nova.compute.manager [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 19:04:00 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:04:00 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-vif-unplugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] No waiting events found dispatching network-vif-unplugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-vif-unplugged-9bf5b734-6480-4406-bce5-25ed601aee83 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] Acquiring lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] No waiting events found dispatching network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:01 user nova-compute[75235]: WARNING nova.compute.manager [req-7502c98e-fca6-4ea0-baa2-2354cf5600dd req-1505ab47-0157-45b7-b993-d874b775086b service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received unexpected event network-vif-plugged-9bf5b734-6480-4406-bce5-25ed601aee83 for instance with vm_state active and task_state deleting.
Nov 29 19:04:01 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:01 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Took 1.15 seconds to deallocate network for instance.
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:02 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:02 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:02 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Deleted allocations for instance 59547806-99f2-4fa7-8f73-4ed1bf2890c1
Nov 29 19:04:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56fc0d21-8606-40ae-b99f-85cfb51157b7 tempest-AttachSCSIVolumeTestJSON-300747578 tempest-AttachSCSIVolumeTestJSON-300747578-project-member] Lock "59547806-99f2-4fa7-8f73-4ed1bf2890c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.798s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-1910db22-65ff-4623-a1cc-c7ab461f04f8 req-903be800-2e6d-4062-b286-d677ced0eac3 service nova] [instance: 59547806-99f2-4fa7-8f73-4ed1bf2890c1] Received event network-vif-deleted-9bf5b734-6480-4406-bce5-25ed601aee83 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:06 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b is timed out.
Nov 29 19:04:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Successfully detached device vdb from instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b from the live domain config.
Nov 29 19:04:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRNpfvhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:04:06 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c87ff4-c719-4a74-8875-04f2bc6a082a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:04:06 user nova-compute[75235]: No targets found.
Nov 29 19:04:06 user nova-compute[75235]: iSNS:
Nov 29 19:04:06 user nova-compute[75235]: No targets found.
Nov 29 19:04:06 user nova-compute[75235]: STATIC:
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:04:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:06 user nova-compute[75235]: FIRMWARE:
Nov 29 19:04:06 user nova-compute[75235]: No targets found.
Nov 29 19:04:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:04:06 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:04:06 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49bdbd-b485-44e7-bc47-e365dca9ef20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24f52f5-3411-4757-947d-a61916920f65]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565812a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699'): ({'sdk'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Removing single pathed devices sdk {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daa6934-724f-4c1e-b896-7746d1476146]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c49ca61-3c66-4610-ab29-7635cbe0541a]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Flushing IO for device /dev/sdk {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9293df-52c4-46f6-a5a7-7c73468c1aab]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ea4e3-c2d5-42e2-bd14-1daea8a887a7]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] SCSI volumes sdk have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eb9a77-9f8e-4b99-83e8-015402c1cd2f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa4309-02aa-480c-a5d8-add46dc06d0e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260]
Nov 29 19:04:06 user nova-compute[75235]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699, portal: 172.16.0.220,3260] successful.
Nov 29 19:04:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e17e66c-52d7-4362-a049-055bb5540699 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338e8f4-7f9a-4c72-9f5a-e3080cbd528f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] <== disconnect_volume: return (354ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:04:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:04:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lazy-loading 'flavor' on Instance uuid 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-311e1fdd-594b-4ce5-a6af-6fb9497361d6 tempest-VolumesAssistedSnapshotsTest-1296325705 tempest-VolumesAssistedSnapshotsTest-1296325705-project-admin] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:04:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:04:12 user nova-compute[75235]: INFO nova.compute.claims [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Claim successful on node user
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:04:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.policy [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09c7bffe8af741b1b1f2542f543d20e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094885e7831048339ba2cdddd4c67a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:04:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Creating image(s)
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "/opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "/opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "/opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk 1073741824" returned: 0 in 0.047s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Successfully created port: e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:04:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Cannot resize image /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Ensure instance console log exists: /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Successfully updated port: e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquired lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-changed-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Refreshing instance network info cache due to event network-changed-e91dad61-a5dd-4c4a-b070-24b33ea61bf6. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] Acquiring lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updating instance_info_cache with network_info: [{"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Releasing lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Instance network_info: |[{"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] Acquired lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Refreshing network info cache for port e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Start _get_guest_xml network_info=[{"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:04:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:04:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1736147809',display_name='tempest-ServersNegativeTestJSON-server-1736147809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1736147809',id=13,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094885e7831048339ba2cdddd4c67a25',ramdisk_id='',reservation_id='r-wqlsnoid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1781487510',owner_user_name='tempest-ServersNegativeTestJSON-1781487510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:13Z,user_data=None,user_id='09c7bffe8af741b1b1f2542f543d20e4',uuid=8abc39f4-4d73-4a69-8acb-d87fe3871867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converting VIF {"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lazy-loading 'pci_devices' on Instance uuid 8abc39f4-4d73-4a69-8acb-d87fe3871867 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:04:14 user nova-compute[75235]:   <uuid>8abc39f4-4d73-4a69-8acb-d87fe3871867</uuid>
Nov 29 19:04:14 user nova-compute[75235]:   <name>instance-0000000d</name>
Nov 29 19:04:14 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:04:14 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:04:14 user nova-compute[75235]:   <metadata>
Nov 29 19:04:14 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:14 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:04:14 user nova-compute[75235]:       <nova:name>tempest-ServersNegativeTestJSON-server-1736147809</nova:name>
Nov 29 19:04:14 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:04:14</nova:creationTime>
Nov 29 19:04:14 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:04:14 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:14 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:04:14 user nova-compute[75235]:       <nova:owner>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:user uuid="09c7bffe8af741b1b1f2542f543d20e4">tempest-ServersNegativeTestJSON-1781487510-project-member</nova:user>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:project uuid="094885e7831048339ba2cdddd4c67a25">tempest-ServersNegativeTestJSON-1781487510</nova:project>
Nov 29 19:04:14 user nova-compute[75235]:       </nova:owner>
Nov 29 19:04:14 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:14 user nova-compute[75235]:       <nova:ports>
Nov 29 19:04:14 user nova-compute[75235]:         <nova:port uuid="e91dad61-a5dd-4c4a-b070-24b33ea61bf6">
Nov 29 19:04:14 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 19:04:14 user nova-compute[75235]:         </nova:port>
Nov 29 19:04:14 user nova-compute[75235]:       </nova:ports>
Nov 29 19:04:14 user nova-compute[75235]:     </nova:instance>
Nov 29 19:04:14 user nova-compute[75235]:   </metadata>
Nov 29 19:04:14 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:04:14 user nova-compute[75235]:     <system>
Nov 29 19:04:14 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:04:14 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:04:14 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:04:14 user nova-compute[75235]:       <entry name="serial">8abc39f4-4d73-4a69-8acb-d87fe3871867</entry>
Nov 29 19:04:14 user nova-compute[75235]:       <entry name="uuid">8abc39f4-4d73-4a69-8acb-d87fe3871867</entry>
Nov 29 19:04:14 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:04:14 user nova-compute[75235]:     </system>
Nov 29 19:04:14 user nova-compute[75235]:   </sysinfo>
Nov 29 19:04:14 user nova-compute[75235]:   <os>
Nov 29 19:04:14 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:04:14 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:04:14 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:04:14 user nova-compute[75235]:   </os>
Nov 29 19:04:14 user nova-compute[75235]:   <features>
Nov 29 19:04:14 user nova-compute[75235]:     <acpi/>
Nov 29 19:04:14 user nova-compute[75235]:     <apic/>
Nov 29 19:04:14 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:04:14 user nova-compute[75235]:   </features>
Nov 29 19:04:14 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:04:14 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:04:14 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:04:14 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:04:14 user nova-compute[75235]:   </clock>
Nov 29 19:04:14 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:04:14 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:04:14 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:04:14 user nova-compute[75235]:   </cpu>
Nov 29 19:04:14 user nova-compute[75235]:   <devices>
Nov 29 19:04:14 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:04:14 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:04:14 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk"/>
Nov 29 19:04:14 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:04:14 user nova-compute[75235]:     </disk>
Nov 29 19:04:14 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:04:14 user nova-compute[75235]:       <mac address="fa:16:3e:17:f8:18"/>
Nov 29 19:04:14 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:04:14 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:04:14 user nova-compute[75235]:       <target dev="tape91dad61-a5"/>
Nov 29 19:04:14 user nova-compute[75235]:     </interface>
Nov 29 19:04:14 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:04:14 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/console.log" append="off"/>
Nov 29 19:04:14 user nova-compute[75235]:     </serial>
Nov 29 19:04:14 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:04:14 user nova-compute[75235]:     <video>
Nov 29 19:04:14 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:04:14 user nova-compute[75235]:     </video>
Nov 29 19:04:14 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:04:14 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:04:14 user nova-compute[75235]:     </rng>
Nov 29 19:04:14 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:04:14 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:04:14 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:04:14 user nova-compute[75235]:     </memballoon>
Nov 29 19:04:14 user nova-compute[75235]:   </devices>
Nov 29 19:04:14 user nova-compute[75235]: </domain>
Nov 29 19:04:14 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1736147809',display_name='tempest-ServersNegativeTestJSON-server-1736147809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1736147809',id=13,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094885e7831048339ba2cdddd4c67a25',ramdisk_id='',reservation_id='r-wqlsnoid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1781487510',owner_user_name='tempest-ServersNegativeTestJSON-1781487510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:13Z,user_data=None,user_id='09c7bffe8af741b1b1f2542f543d20e4',uuid=8abc39f4-4d73-4a69-8acb-d87fe3871867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converting VIF {"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG os_vif [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9f4e4c6-8d72-5a47-900d-bf65f5975b4e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape91dad61-a5, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape91dad61-a5, col_values=(('qos', UUID('64bc2066-3060-48d5-9903-7263ed98352a')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape91dad61-a5, col_values=(('external_ids', {'iface-id': 'e91dad61-a5dd-4c4a-b070-24b33ea61bf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:f8:18', 'vm-uuid': '8abc39f4-4d73-4a69-8acb-d87fe3871867'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:14 user nova-compute[75235]: INFO os_vif [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5')
Nov 29 19:04:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:04:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] No VIF found with MAC fa:16:3e:17:f8:18, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:04:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updated VIF entry in instance network info cache for port e91dad61-a5dd-4c4a-b070-24b33ea61bf6. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:04:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updating instance_info_cache with network_info: [{"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a59a707-b6e0-43c2-9cdd-ac68e868d769 req-f15623db-e99e-4efe-869e-df5898c58c6e service nova] Releasing lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-ef41c750-0d6c-4e00-865b-8b07b92718f1 req-610a9cd9-3211-4126-8b06-006d95f287ea service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ef41c750-0d6c-4e00-865b-8b07b92718f1 req-610a9cd9-3211-4126-8b06-006d95f287ea service nova] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ef41c750-0d6c-4e00-865b-8b07b92718f1 req-610a9cd9-3211-4126-8b06-006d95f287ea service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ef41c750-0d6c-4e00-865b-8b07b92718f1 req-610a9cd9-3211-4126-8b06-006d95f287ea service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-ef41c750-0d6c-4e00-865b-8b07b92718f1 req-610a9cd9-3211-4126-8b06-006d95f287ea service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] No waiting events found dispatching network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:16 user nova-compute[75235]: WARNING nova.compute.manager [req-ef41c750-0d6c-4e00-865b-8b07b92718f1 req-610a9cd9-3211-4126-8b06-006d95f287ea service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received unexpected event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 for instance with vm_state building and task_state spawning.
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Waiting for libvirt event about the detach of device tapdfb094f0-d6 with device alias net1 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf is timed out.
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface> {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 19:04:17 user nova-compute[75235]:   <name>instance-00000007</name>
Nov 29 19:04:17 user nova-compute[75235]:   <uuid>d7e65309-b31e-4e11-bc9c-495c13d276bf</uuid>
Nov 29 19:04:17 user nova-compute[75235]:   <metadata>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:17 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:03:20</nova:creationTime>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:04:17 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:ports>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:04:17 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:04:17 user nova-compute[75235]:     </nova:port>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:port uuid="dfb094f0-d65f-4581-8182-206ea4107c03">
Nov 29 19:04:17 user nova-compute[75235]:       <nova:ip type="fixed" address="10.10.10.170" ipVersion="4"/>
Nov 29 19:04:17 user nova-compute[75235]:     </nova:port>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:ports>
Nov 29 19:04:17 user nova-compute[75235]: </nova:instance>
Nov 29 19:04:17 user nova-compute[75235]:   </metadata>
Nov 29 19:04:17 user nova-compute[75235]:   <memory unit='KiB'>524288</memory>
Nov 29 19:04:17 user nova-compute[75235]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 19:04:17 user nova-compute[75235]:   <vcpu placement='static'>1</vcpu>
Nov 29 19:04:17 user nova-compute[75235]:   <resource>
Nov 29 19:04:17 user nova-compute[75235]:     <partition>/machine</partition>
Nov 29 19:04:17 user nova-compute[75235]:   </resource>
Nov 29 19:04:17 user nova-compute[75235]:   <sysinfo type='smbios'>
Nov 29 19:04:17 user nova-compute[75235]:     <system>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='version'>0.0.0</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='serial'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='uuid'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='family'>Virtual Machine</entry>
Nov 29 19:04:17 user nova-compute[75235]:     </system>
Nov 29 19:04:17 user nova-compute[75235]:   </sysinfo>
Nov 29 19:04:17 user nova-compute[75235]:   <os>
Nov 29 19:04:17 user nova-compute[75235]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 19:04:17 user nova-compute[75235]:     <boot dev='hd'/>
Nov 29 19:04:17 user nova-compute[75235]:     <smbios mode='sysinfo'/>
Nov 29 19:04:17 user nova-compute[75235]:   </os>
Nov 29 19:04:17 user nova-compute[75235]:   <features>
Nov 29 19:04:17 user nova-compute[75235]:     <acpi/>
Nov 29 19:04:17 user nova-compute[75235]:     <apic/>
Nov 29 19:04:17 user nova-compute[75235]:     <vmcoreinfo state='on'/>
Nov 29 19:04:17 user nova-compute[75235]:   </features>
Nov 29 19:04:17 user nova-compute[75235]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 19:04:17 user nova-compute[75235]:     <model fallback='forbid'>Nehalem</model>
Nov 29 19:04:17 user nova-compute[75235]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='vme'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='x2apic'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='hypervisor'/>
Nov 29 19:04:17 user nova-compute[75235]:   </cpu>
Nov 29 19:04:17 user nova-compute[75235]:   <clock offset='utc'>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='hpet' present='no'/>
Nov 29 19:04:17 user nova-compute[75235]:   </clock>
Nov 29 19:04:17 user nova-compute[75235]:   <on_poweroff>destroy</on_poweroff>
Nov 29 19:04:17 user nova-compute[75235]:   <on_reboot>restart</on_reboot>
Nov 29 19:04:17 user nova-compute[75235]:   <on_crash>destroy</on_crash>
Nov 29 19:04:17 user nova-compute[75235]:   <devices>
Nov 29 19:04:17 user nova-compute[75235]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 19:04:17 user nova-compute[75235]:     <disk type='file' device='disk'>
Nov 29 19:04:17 user nova-compute[75235]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 19:04:17 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk' index='2'/>
Nov 29 19:04:17 user nova-compute[75235]:       <backingStore type='file' index='3'>
Nov 29 19:04:17 user nova-compute[75235]:         <format type='raw'/>
Nov 29 19:04:17 user nova-compute[75235]:         <source file='/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0'/>
Nov 29 19:04:17 user nova-compute[75235]:         <backingStore/>
Nov 29 19:04:17 user nova-compute[75235]:       </backingStore>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='vda' bus='virtio'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='virtio-disk0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </disk>
Nov 29 19:04:17 user nova-compute[75235]:     <disk type='file' device='cdrom'>
Nov 29 19:04:17 user nova-compute[75235]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 19:04:17 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config' index='1'/>
Nov 29 19:04:17 user nova-compute[75235]:       <backingStore/>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='hda' bus='ide'/>
Nov 29 19:04:17 user nova-compute[75235]:       <readonly/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='ide0-0-0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </disk>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='usb' index='0' model='none'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='usb'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='pci.0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='ide' index='0'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='ide'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <interface type='ethernet'>
Nov 29 19:04:17 user nova-compute[75235]:       <mac address='fa:16:3e:5d:6c:67'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='tap5b1fd2ee-3e'/>
Nov 29 19:04:17 user nova-compute[75235]:       <model type='virtio'/>
Nov 29 19:04:17 user nova-compute[75235]:       <mtu size='1442'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='net0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </interface>
Nov 29 19:04:17 user nova-compute[75235]:     <serial type='pty'>
Nov 29 19:04:17 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:04:17 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target type='isa-serial' port='0'>
Nov 29 19:04:17 user nova-compute[75235]:         <model name='isa-serial'/>
Nov 29 19:04:17 user nova-compute[75235]:       </target>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </serial>
Nov 29 19:04:17 user nova-compute[75235]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 19:04:17 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:04:17 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target type='serial' port='0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </console>
Nov 29 19:04:17 user nova-compute[75235]:     <input type='mouse' bus='ps2'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='input0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </input>
Nov 29 19:04:17 user nova-compute[75235]:     <input type='keyboard' bus='ps2'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='input1'/>
Nov 29 19:04:17 user nova-compute[75235]:     </input>
Nov 29 19:04:17 user nova-compute[75235]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 19:04:17 user nova-compute[75235]:       <listen type='address' address='0.0.0.0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </graphics>
Nov 29 19:04:17 user nova-compute[75235]:     <audio id='1' type='none'/>
Nov 29 19:04:17 user nova-compute[75235]:     <video>
Nov 29 19:04:17 user nova-compute[75235]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='video0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </video>
Nov 29 19:04:17 user nova-compute[75235]:     <memballoon model='virtio'>
Nov 29 19:04:17 user nova-compute[75235]:       <stats period='10'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='balloon0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </memballoon>
Nov 29 19:04:17 user nova-compute[75235]:     <rng model='virtio'>
Nov 29 19:04:17 user nova-compute[75235]:       <backend model='random'>/dev/urandom</backend>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='rng0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </rng>
Nov 29 19:04:17 user nova-compute[75235]:   </devices>
Nov 29 19:04:17 user nova-compute[75235]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 19:04:17 user nova-compute[75235]:     <label>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</label>
Nov 29 19:04:17 user nova-compute[75235]:     <imagelabel>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</imagelabel>
Nov 29 19:04:17 user nova-compute[75235]:   </seclabel>
Nov 29 19:04:17 user nova-compute[75235]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 19:04:17 user nova-compute[75235]:     <label>+64055:+108</label>
Nov 29 19:04:17 user nova-compute[75235]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 19:04:17 user nova-compute[75235]:   </seclabel>
Nov 29 19:04:17 user nova-compute[75235]: </domain>
Nov 29 19:04:17 user nova-compute[75235]:  {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 19:04:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully detached device tapdfb094f0-d6 from instance d7e65309-b31e-4e11-bc9c-495c13d276bf from the live domain config.
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG os_vif [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfb094f0-d6, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7aae491-5da3-4d71-8757-ff396038701f) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: INFO os_vif [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6')
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:17 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:04:17</nova:creationTime>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:04:17 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:ports>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:04:17 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:04:17 user nova-compute[75235]:     </nova:port>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:ports>
Nov 29 19:04:17 user nova-compute[75235]: </nova:instance>
Nov 29 19:04:17 user nova-compute[75235]:  {{(pid=75235) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-deleted-dfb094f0-d65f-4581-8182-206ea4107c03 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:17 user nova-compute[75235]: INFO nova.compute.manager [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Neutron deleted interface dfb094f0-d65f-4581-8182-206ea4107c03; detaching it from the instance and deleting it from the info cache
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.neutron [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquired lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.objects.instance [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Lazy-loading 'system_metadata' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.objects.instance [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Lazy-loading 'flavor' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.objects.base [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Object Instance<d7e65309-b31e-4e11-bc9c-495c13d276bf> lazy-loaded attributes: system_metadata,flavor {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Converting VIF {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface> {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 19:04:17 user nova-compute[75235]:   <name>instance-00000007</name>
Nov 29 19:04:17 user nova-compute[75235]:   <uuid>d7e65309-b31e-4e11-bc9c-495c13d276bf</uuid>
Nov 29 19:04:17 user nova-compute[75235]:   <metadata>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:17 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:04:17</nova:creationTime>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:04:17 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:ports>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:04:17 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:04:17 user nova-compute[75235]:     </nova:port>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:ports>
Nov 29 19:04:17 user nova-compute[75235]: </nova:instance>
Nov 29 19:04:17 user nova-compute[75235]:   </metadata>
Nov 29 19:04:17 user nova-compute[75235]:   <memory unit='KiB'>524288</memory>
Nov 29 19:04:17 user nova-compute[75235]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 19:04:17 user nova-compute[75235]:   <vcpu placement='static'>1</vcpu>
Nov 29 19:04:17 user nova-compute[75235]:   <resource>
Nov 29 19:04:17 user nova-compute[75235]:     <partition>/machine</partition>
Nov 29 19:04:17 user nova-compute[75235]:   </resource>
Nov 29 19:04:17 user nova-compute[75235]:   <sysinfo type='smbios'>
Nov 29 19:04:17 user nova-compute[75235]:     <system>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='version'>0.0.0</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='serial'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='uuid'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='family'>Virtual Machine</entry>
Nov 29 19:04:17 user nova-compute[75235]:     </system>
Nov 29 19:04:17 user nova-compute[75235]:   </sysinfo>
Nov 29 19:04:17 user nova-compute[75235]:   <os>
Nov 29 19:04:17 user nova-compute[75235]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 19:04:17 user nova-compute[75235]:     <boot dev='hd'/>
Nov 29 19:04:17 user nova-compute[75235]:     <smbios mode='sysinfo'/>
Nov 29 19:04:17 user nova-compute[75235]:   </os>
Nov 29 19:04:17 user nova-compute[75235]:   <features>
Nov 29 19:04:17 user nova-compute[75235]:     <acpi/>
Nov 29 19:04:17 user nova-compute[75235]:     <apic/>
Nov 29 19:04:17 user nova-compute[75235]:     <vmcoreinfo state='on'/>
Nov 29 19:04:17 user nova-compute[75235]:   </features>
Nov 29 19:04:17 user nova-compute[75235]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 19:04:17 user nova-compute[75235]:     <model fallback='forbid'>Nehalem</model>
Nov 29 19:04:17 user nova-compute[75235]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='vme'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='x2apic'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='hypervisor'/>
Nov 29 19:04:17 user nova-compute[75235]:   </cpu>
Nov 29 19:04:17 user nova-compute[75235]:   <clock offset='utc'>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='hpet' present='no'/>
Nov 29 19:04:17 user nova-compute[75235]:   </clock>
Nov 29 19:04:17 user nova-compute[75235]:   <on_poweroff>destroy</on_poweroff>
Nov 29 19:04:17 user nova-compute[75235]:   <on_reboot>restart</on_reboot>
Nov 29 19:04:17 user nova-compute[75235]:   <on_crash>destroy</on_crash>
Nov 29 19:04:17 user nova-compute[75235]:   <devices>
Nov 29 19:04:17 user nova-compute[75235]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 19:04:17 user nova-compute[75235]:     <disk type='file' device='disk'>
Nov 29 19:04:17 user nova-compute[75235]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 19:04:17 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk' index='2'/>
Nov 29 19:04:17 user nova-compute[75235]:       <backingStore type='file' index='3'>
Nov 29 19:04:17 user nova-compute[75235]:         <format type='raw'/>
Nov 29 19:04:17 user nova-compute[75235]:         <source file='/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0'/>
Nov 29 19:04:17 user nova-compute[75235]:         <backingStore/>
Nov 29 19:04:17 user nova-compute[75235]:       </backingStore>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='vda' bus='virtio'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='virtio-disk0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </disk>
Nov 29 19:04:17 user nova-compute[75235]:     <disk type='file' device='cdrom'>
Nov 29 19:04:17 user nova-compute[75235]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 19:04:17 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config' index='1'/>
Nov 29 19:04:17 user nova-compute[75235]:       <backingStore/>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='hda' bus='ide'/>
Nov 29 19:04:17 user nova-compute[75235]:       <readonly/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='ide0-0-0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </disk>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='usb' index='0' model='none'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='usb'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='pci.0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='ide' index='0'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='ide'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <interface type='ethernet'>
Nov 29 19:04:17 user nova-compute[75235]:       <mac address='fa:16:3e:5d:6c:67'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='tap5b1fd2ee-3e'/>
Nov 29 19:04:17 user nova-compute[75235]:       <model type='virtio'/>
Nov 29 19:04:17 user nova-compute[75235]:       <mtu size='1442'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='net0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </interface>
Nov 29 19:04:17 user nova-compute[75235]:     <serial type='pty'>
Nov 29 19:04:17 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:04:17 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target type='isa-serial' port='0'>
Nov 29 19:04:17 user nova-compute[75235]:         <model name='isa-serial'/>
Nov 29 19:04:17 user nova-compute[75235]:       </target>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </serial>
Nov 29 19:04:17 user nova-compute[75235]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 19:04:17 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:04:17 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target type='serial' port='0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </console>
Nov 29 19:04:17 user nova-compute[75235]:     <input type='mouse' bus='ps2'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='input0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </input>
Nov 29 19:04:17 user nova-compute[75235]:     <input type='keyboard' bus='ps2'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='input1'/>
Nov 29 19:04:17 user nova-compute[75235]:     </input>
Nov 29 19:04:17 user nova-compute[75235]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 19:04:17 user nova-compute[75235]:       <listen type='address' address='0.0.0.0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </graphics>
Nov 29 19:04:17 user nova-compute[75235]:     <audio id='1' type='none'/>
Nov 29 19:04:17 user nova-compute[75235]:     <video>
Nov 29 19:04:17 user nova-compute[75235]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='video0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </video>
Nov 29 19:04:17 user nova-compute[75235]:     <memballoon model='virtio'>
Nov 29 19:04:17 user nova-compute[75235]:       <stats period='10'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='balloon0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </memballoon>
Nov 29 19:04:17 user nova-compute[75235]:     <rng model='virtio'>
Nov 29 19:04:17 user nova-compute[75235]:       <backend model='random'>/dev/urandom</backend>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='rng0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </rng>
Nov 29 19:04:17 user nova-compute[75235]:   </devices>
Nov 29 19:04:17 user nova-compute[75235]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 19:04:17 user nova-compute[75235]:     <label>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</label>
Nov 29 19:04:17 user nova-compute[75235]:     <imagelabel>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</imagelabel>
Nov 29 19:04:17 user nova-compute[75235]:   </seclabel>
Nov 29 19:04:17 user nova-compute[75235]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 19:04:17 user nova-compute[75235]:     <label>+64055:+108</label>
Nov 29 19:04:17 user nova-compute[75235]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 19:04:17 user nova-compute[75235]:   </seclabel>
Nov 29 19:04:17 user nova-compute[75235]: </domain>
Nov 29 19:04:17 user nova-compute[75235]:  {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface> {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d2:90"/><model type="virtio"/><mtu size="1442"/><target dev="tapdfb094f0-d6"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 19:04:17 user nova-compute[75235]:   <name>instance-00000007</name>
Nov 29 19:04:17 user nova-compute[75235]:   <uuid>d7e65309-b31e-4e11-bc9c-495c13d276bf</uuid>
Nov 29 19:04:17 user nova-compute[75235]:   <metadata>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:17 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:04:17</nova:creationTime>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:04:17 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:ports>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:04:17 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:04:17 user nova-compute[75235]:     </nova:port>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:ports>
Nov 29 19:04:17 user nova-compute[75235]: </nova:instance>
Nov 29 19:04:17 user nova-compute[75235]:   </metadata>
Nov 29 19:04:17 user nova-compute[75235]:   <memory unit='KiB'>524288</memory>
Nov 29 19:04:17 user nova-compute[75235]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 19:04:17 user nova-compute[75235]:   <vcpu placement='static'>1</vcpu>
Nov 29 19:04:17 user nova-compute[75235]:   <resource>
Nov 29 19:04:17 user nova-compute[75235]:     <partition>/machine</partition>
Nov 29 19:04:17 user nova-compute[75235]:   </resource>
Nov 29 19:04:17 user nova-compute[75235]:   <sysinfo type='smbios'>
Nov 29 19:04:17 user nova-compute[75235]:     <system>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='version'>0.0.0</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='serial'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='uuid'>d7e65309-b31e-4e11-bc9c-495c13d276bf</entry>
Nov 29 19:04:17 user nova-compute[75235]:       <entry name='family'>Virtual Machine</entry>
Nov 29 19:04:17 user nova-compute[75235]:     </system>
Nov 29 19:04:17 user nova-compute[75235]:   </sysinfo>
Nov 29 19:04:17 user nova-compute[75235]:   <os>
Nov 29 19:04:17 user nova-compute[75235]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 19:04:17 user nova-compute[75235]:     <boot dev='hd'/>
Nov 29 19:04:17 user nova-compute[75235]:     <smbios mode='sysinfo'/>
Nov 29 19:04:17 user nova-compute[75235]:   </os>
Nov 29 19:04:17 user nova-compute[75235]:   <features>
Nov 29 19:04:17 user nova-compute[75235]:     <acpi/>
Nov 29 19:04:17 user nova-compute[75235]:     <apic/>
Nov 29 19:04:17 user nova-compute[75235]:     <vmcoreinfo state='on'/>
Nov 29 19:04:17 user nova-compute[75235]:   </features>
Nov 29 19:04:17 user nova-compute[75235]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 19:04:17 user nova-compute[75235]:     <model fallback='forbid'>Nehalem</model>
Nov 29 19:04:17 user nova-compute[75235]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='vme'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='x2apic'/>
Nov 29 19:04:17 user nova-compute[75235]:     <feature policy='require' name='hypervisor'/>
Nov 29 19:04:17 user nova-compute[75235]:   </cpu>
Nov 29 19:04:17 user nova-compute[75235]:   <clock offset='utc'>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 19:04:17 user nova-compute[75235]:     <timer name='hpet' present='no'/>
Nov 29 19:04:17 user nova-compute[75235]:   </clock>
Nov 29 19:04:17 user nova-compute[75235]:   <on_poweroff>destroy</on_poweroff>
Nov 29 19:04:17 user nova-compute[75235]:   <on_reboot>restart</on_reboot>
Nov 29 19:04:17 user nova-compute[75235]:   <on_crash>destroy</on_crash>
Nov 29 19:04:17 user nova-compute[75235]:   <devices>
Nov 29 19:04:17 user nova-compute[75235]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 19:04:17 user nova-compute[75235]:     <disk type='file' device='disk'>
Nov 29 19:04:17 user nova-compute[75235]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 19:04:17 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk' index='2'/>
Nov 29 19:04:17 user nova-compute[75235]:       <backingStore type='file' index='3'>
Nov 29 19:04:17 user nova-compute[75235]:         <format type='raw'/>
Nov 29 19:04:17 user nova-compute[75235]:         <source file='/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0'/>
Nov 29 19:04:17 user nova-compute[75235]:         <backingStore/>
Nov 29 19:04:17 user nova-compute[75235]:       </backingStore>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='vda' bus='virtio'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='virtio-disk0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </disk>
Nov 29 19:04:17 user nova-compute[75235]:     <disk type='file' device='cdrom'>
Nov 29 19:04:17 user nova-compute[75235]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 19:04:17 user nova-compute[75235]:       <source file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/disk.config' index='1'/>
Nov 29 19:04:17 user nova-compute[75235]:       <backingStore/>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='hda' bus='ide'/>
Nov 29 19:04:17 user nova-compute[75235]:       <readonly/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='ide0-0-0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </disk>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='usb' index='0' model='none'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='usb'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='pci.0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <controller type='ide' index='0'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='ide'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 19:04:17 user nova-compute[75235]:     </controller>
Nov 29 19:04:17 user nova-compute[75235]:     <interface type='ethernet'>
Nov 29 19:04:17 user nova-compute[75235]:       <mac address='fa:16:3e:5d:6c:67'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target dev='tap5b1fd2ee-3e'/>
Nov 29 19:04:17 user nova-compute[75235]:       <model type='virtio'/>
Nov 29 19:04:17 user nova-compute[75235]:       <mtu size='1442'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='net0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </interface>
Nov 29 19:04:17 user nova-compute[75235]:     <serial type='pty'>
Nov 29 19:04:17 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:04:17 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target type='isa-serial' port='0'>
Nov 29 19:04:17 user nova-compute[75235]:         <model name='isa-serial'/>
Nov 29 19:04:17 user nova-compute[75235]:       </target>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </serial>
Nov 29 19:04:17 user nova-compute[75235]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 19:04:17 user nova-compute[75235]:       <source path='/dev/pts/6'/>
Nov 29 19:04:17 user nova-compute[75235]:       <log file='/opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf/console.log' append='off'/>
Nov 29 19:04:17 user nova-compute[75235]:       <target type='serial' port='0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='serial0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </console>
Nov 29 19:04:17 user nova-compute[75235]:     <input type='mouse' bus='ps2'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='input0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </input>
Nov 29 19:04:17 user nova-compute[75235]:     <input type='keyboard' bus='ps2'>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='input1'/>
Nov 29 19:04:17 user nova-compute[75235]:     </input>
Nov 29 19:04:17 user nova-compute[75235]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 19:04:17 user nova-compute[75235]:       <listen type='address' address='0.0.0.0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </graphics>
Nov 29 19:04:17 user nova-compute[75235]:     <audio id='1' type='none'/>
Nov 29 19:04:17 user nova-compute[75235]:     <video>
Nov 29 19:04:17 user nova-compute[75235]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='video0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </video>
Nov 29 19:04:17 user nova-compute[75235]:     <memballoon model='virtio'>
Nov 29 19:04:17 user nova-compute[75235]:       <stats period='10'/>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='balloon0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </memballoon>
Nov 29 19:04:17 user nova-compute[75235]:     <rng model='virtio'>
Nov 29 19:04:17 user nova-compute[75235]:       <backend model='random'>/dev/urandom</backend>
Nov 29 19:04:17 user nova-compute[75235]:       <alias name='rng0'/>
Nov 29 19:04:17 user nova-compute[75235]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 19:04:17 user nova-compute[75235]:     </rng>
Nov 29 19:04:17 user nova-compute[75235]:   </devices>
Nov 29 19:04:17 user nova-compute[75235]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 19:04:17 user nova-compute[75235]:     <label>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</label>
Nov 29 19:04:17 user nova-compute[75235]:     <imagelabel>libvirt-d7e65309-b31e-4e11-bc9c-495c13d276bf</imagelabel>
Nov 29 19:04:17 user nova-compute[75235]:   </seclabel>
Nov 29 19:04:17 user nova-compute[75235]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 19:04:17 user nova-compute[75235]:     <label>+64055:+108</label>
Nov 29 19:04:17 user nova-compute[75235]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 19:04:17 user nova-compute[75235]:   </seclabel>
Nov 29 19:04:17 user nova-compute[75235]: </domain>
Nov 29 19:04:17 user nova-compute[75235]:  {{(pid=75235) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 19:04:17 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Detaching interface fa:16:3e:d8:d2:90 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapdfb094f0-d6' not found.
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Converting VIF {"id": "dfb094f0-d65f-4581-8182-206ea4107c03", "address": "fa:16:3e:d8:d2:90", "network": {"id": "ef0463af-1a5e-4d06-a0c3-57d054576d62", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-563239631", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb094f0-d6", "ovs_interfaceid": "dfb094f0-d65f-4581-8182-206ea4107c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG os_vif [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfb094f0-d6, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:04:17 user nova-compute[75235]: INFO os_vif [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d2:90,bridge_name='br-int',has_traffic_filtering=True,id=dfb094f0-d65f-4581-8182-206ea4107c03,network=Network(ef0463af-1a5e-4d06-a0c3-57d054576d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb094f0-d6')
Nov 29 19:04:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [req-a61cea1b-fe24-4ecb-ab16-a3e4321061b5 req-138d765c-29bc-4911-b314-0032df4c1035 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:17 user nova-compute[75235]:   <nova:package version="0.0.0"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:name>tempest-device-tagging-server-285421719</nova:name>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:creationTime>2023-11-29 19:04:17</nova:creationTime>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:flavor name="m1.tiny">
Nov 29 19:04:17 user nova-compute[75235]:     <nova:memory>512</nova:memory>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:disk>1</nova:disk>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:swap>0</nova:swap>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:flavor>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:user uuid="18f21971b2c04c03922cca2bd064cc4c">tempest-TaggedAttachmentsTest-1605261122-project-member</nova:user>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:project uuid="749fed6b75994169b86c6e7cf2fe8603">tempest-TaggedAttachmentsTest-1605261122</nova:project>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:owner>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:17 user nova-compute[75235]:   <nova:ports>
Nov 29 19:04:17 user nova-compute[75235]:     <nova:port uuid="5b1fd2ee-3e0c-4951-8909-25b853d04b1c">
Nov 29 19:04:17 user nova-compute[75235]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:04:17 user nova-compute[75235]:     </nova:port>
Nov 29 19:04:17 user nova-compute[75235]:   </nova:ports>
Nov 29 19:04:17 user nova-compute[75235]: </nova:instance>
Nov 29 19:04:17 user nova-compute[75235]:  {{(pid=75235) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [{"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Releasing lock "refresh_cache-d7e65309-b31e-4e11-bc9c-495c13d276bf" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cc4f606-2938-4c3d-ad83-22a05fc696f9 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "interface-d7e65309-b31e-4e11-bc9c-495c13d276bf-dfb094f0-d65f-4581-8182-206ea4107c03" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.371s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:04:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Instance spawned successfully.
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:18 user nova-compute[75235]: INFO nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-46599726-6897-448a-b675-ef6744522efb req-ecc32cdd-e3d0-4de7-ae51-9c7e7be95485 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-46599726-6897-448a-b675-ef6744522efb req-ecc32cdd-e3d0-4de7-ae51-9c7e7be95485 service nova] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-46599726-6897-448a-b675-ef6744522efb req-ecc32cdd-e3d0-4de7-ae51-9c7e7be95485 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-46599726-6897-448a-b675-ef6744522efb req-ecc32cdd-e3d0-4de7-ae51-9c7e7be95485 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-46599726-6897-448a-b675-ef6744522efb req-ecc32cdd-e3d0-4de7-ae51-9c7e7be95485 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] No waiting events found dispatching network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:18 user nova-compute[75235]: WARNING nova.compute.manager [req-46599726-6897-448a-b675-ef6744522efb req-ecc32cdd-e3d0-4de7-ae51-9c7e7be95485 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received unexpected event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 for instance with vm_state building and task_state spawning.
Nov 29 19:04:18 user nova-compute[75235]: INFO nova.compute.manager [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Took 5.93 seconds to build instance.
Nov 29 19:04:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-543a8a77-1edc-4e7e-a607-2723e38da099 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.018s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:04:20 user nova-compute[75235]: INFO nova.compute.claims [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Claim successful on node user
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:04:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.policy [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f516b841e854f1dbc8518c1e346fb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbea24130784a9fbd5a9572e30b3094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:04:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Creating image(s)
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "/opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "/opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "/opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk 1073741824" returned: 0 in 0.055s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Successfully created port: 4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Cannot resize image /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Ensure instance console log exists: /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Successfully updated port: 4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "refresh_cache-05533a2c-8f8e-4bfd-8b36-92470a10d5e6" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquired lock "refresh_cache-05533a2c-8f8e-4bfd-8b36-92470a10d5e6" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-changed-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Refreshing instance network info cache due to event network-changed-4da2823a-d6fa-4e92-8f74-21ba3aa0666d. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] Acquiring lock "refresh_cache-05533a2c-8f8e-4bfd-8b36-92470a10d5e6" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Updating instance_info_cache with network_info: [{"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Releasing lock "refresh_cache-05533a2c-8f8e-4bfd-8b36-92470a10d5e6" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Instance network_info: |[{"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] Acquired lock "refresh_cache-05533a2c-8f8e-4bfd-8b36-92470a10d5e6" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Refreshing network info cache for port 4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Start _get_guest_xml network_info=[{"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:04:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:04:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1179164610',display_name='tempest-VolumesAdminNegativeTest-server-1179164610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1179164610',id=14,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbbea24130784a9fbd5a9572e30b3094',ramdisk_id='',reservation_id='r-tx3ecqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1338291818',owner_user_name='tempest-VolumesAdminNegativeTest-1338291818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:21Z,user_data=None,user_id='8f516b841e854f1dbc8518c1e346fb0d',uuid=05533a2c-8f8e-4bfd-8b36-92470a10d5e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converting VIF {"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'pci_devices' on Instance uuid 05533a2c-8f8e-4bfd-8b36-92470a10d5e6 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:04:22 user nova-compute[75235]:   <uuid>05533a2c-8f8e-4bfd-8b36-92470a10d5e6</uuid>
Nov 29 19:04:22 user nova-compute[75235]:   <name>instance-0000000e</name>
Nov 29 19:04:22 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:04:22 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:04:22 user nova-compute[75235]:   <metadata>
Nov 29 19:04:22 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:04:22 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:04:22 user nova-compute[75235]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1179164610</nova:name>
Nov 29 19:04:22 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:04:22</nova:creationTime>
Nov 29 19:04:22 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:04:22 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:04:22 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:04:22 user nova-compute[75235]:       <nova:owner>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:user uuid="8f516b841e854f1dbc8518c1e346fb0d">tempest-VolumesAdminNegativeTest-1338291818-project-member</nova:user>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:project uuid="cbbea24130784a9fbd5a9572e30b3094">tempest-VolumesAdminNegativeTest-1338291818</nova:project>
Nov 29 19:04:22 user nova-compute[75235]:       </nova:owner>
Nov 29 19:04:22 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:04:22 user nova-compute[75235]:       <nova:ports>
Nov 29 19:04:22 user nova-compute[75235]:         <nova:port uuid="4da2823a-d6fa-4e92-8f74-21ba3aa0666d">
Nov 29 19:04:22 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:04:22 user nova-compute[75235]:         </nova:port>
Nov 29 19:04:22 user nova-compute[75235]:       </nova:ports>
Nov 29 19:04:22 user nova-compute[75235]:     </nova:instance>
Nov 29 19:04:22 user nova-compute[75235]:   </metadata>
Nov 29 19:04:22 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:04:22 user nova-compute[75235]:     <system>
Nov 29 19:04:22 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:04:22 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:04:22 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:04:22 user nova-compute[75235]:       <entry name="serial">05533a2c-8f8e-4bfd-8b36-92470a10d5e6</entry>
Nov 29 19:04:22 user nova-compute[75235]:       <entry name="uuid">05533a2c-8f8e-4bfd-8b36-92470a10d5e6</entry>
Nov 29 19:04:22 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:04:22 user nova-compute[75235]:     </system>
Nov 29 19:04:22 user nova-compute[75235]:   </sysinfo>
Nov 29 19:04:22 user nova-compute[75235]:   <os>
Nov 29 19:04:22 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:04:22 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:04:22 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:04:22 user nova-compute[75235]:   </os>
Nov 29 19:04:22 user nova-compute[75235]:   <features>
Nov 29 19:04:22 user nova-compute[75235]:     <acpi/>
Nov 29 19:04:22 user nova-compute[75235]:     <apic/>
Nov 29 19:04:22 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:04:22 user nova-compute[75235]:   </features>
Nov 29 19:04:22 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:04:22 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:04:22 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:04:22 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:04:22 user nova-compute[75235]:   </clock>
Nov 29 19:04:22 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:04:22 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:04:22 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:04:22 user nova-compute[75235]:   </cpu>
Nov 29 19:04:22 user nova-compute[75235]:   <devices>
Nov 29 19:04:22 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:04:22 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:04:22 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk"/>
Nov 29 19:04:22 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:04:22 user nova-compute[75235]:     </disk>
Nov 29 19:04:22 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:04:22 user nova-compute[75235]:       <mac address="fa:16:3e:f5:ee:2e"/>
Nov 29 19:04:22 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:04:22 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:04:22 user nova-compute[75235]:       <target dev="tap4da2823a-d6"/>
Nov 29 19:04:22 user nova-compute[75235]:     </interface>
Nov 29 19:04:22 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:04:22 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/console.log" append="off"/>
Nov 29 19:04:22 user nova-compute[75235]:     </serial>
Nov 29 19:04:22 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:04:22 user nova-compute[75235]:     <video>
Nov 29 19:04:22 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:04:22 user nova-compute[75235]:     </video>
Nov 29 19:04:22 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:04:22 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:04:22 user nova-compute[75235]:     </rng>
Nov 29 19:04:22 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:04:22 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:04:22 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:04:22 user nova-compute[75235]:     </memballoon>
Nov 29 19:04:22 user nova-compute[75235]:   </devices>
Nov 29 19:04:22 user nova-compute[75235]: </domain>
Nov 29 19:04:22 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1179164610',display_name='tempest-VolumesAdminNegativeTest-server-1179164610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1179164610',id=14,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbbea24130784a9fbd5a9572e30b3094',ramdisk_id='',reservation_id='r-tx3ecqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1338291818',owner_user_name='tempest-VolumesAdminNegativeTest-1338291818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:21Z,user_data=None,user_id='8f516b841e854f1dbc8518c1e346fb0d',uuid=05533a2c-8f8e-4bfd-8b36-92470a10d5e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converting VIF {"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG os_vif [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc4f3638-dd95-5692-9210-604dc835e6e6', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4da2823a-d6, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4da2823a-d6, col_values=(('qos', UUID('05f2d078-6962-4373-ba4e-5ff5d7ee154e')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4da2823a-d6, col_values=(('external_ids', {'iface-id': '4da2823a-d6fa-4e92-8f74-21ba3aa0666d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ee:2e', 'vm-uuid': '05533a2c-8f8e-4bfd-8b36-92470a10d5e6'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:22 user nova-compute[75235]: INFO os_vif [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6')
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] No VIF found with MAC fa:16:3e:f5:ee:2e, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Updated VIF entry in instance network info cache for port 4da2823a-d6fa-4e92-8f74-21ba3aa0666d. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Updating instance_info_cache with network_info: [{"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d5167cd-ed72-41c1-a2fa-7c99eb11a5b6 req-6eec14f9-a1a9-4115-b3cb-e22a0835addb service nova] Releasing lock "refresh_cache-05533a2c-8f8e-4bfd-8b36-92470a10d5e6" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-96f31ece-af67-46d4-9717-ac9a4d98cb45 req-2ef5ae7f-13f0-4632-a5bf-fa3777181d61 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-96f31ece-af67-46d4-9717-ac9a4d98cb45 req-2ef5ae7f-13f0-4632-a5bf-fa3777181d61 service nova] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-96f31ece-af67-46d4-9717-ac9a4d98cb45 req-2ef5ae7f-13f0-4632-a5bf-fa3777181d61 service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-96f31ece-af67-46d4-9717-ac9a4d98cb45 req-2ef5ae7f-13f0-4632-a5bf-fa3777181d61 service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-96f31ece-af67-46d4-9717-ac9a4d98cb45 req-2ef5ae7f-13f0-4632-a5bf-fa3777181d61 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] No waiting events found dispatching network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:24 user nova-compute[75235]: WARNING nova.compute.manager [req-96f31ece-af67-46d4-9717-ac9a4d98cb45 req-2ef5ae7f-13f0-4632-a5bf-fa3777181d61 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received unexpected event network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d for instance with vm_state building and task_state spawning.
Nov 29 19:04:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:04:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Instance spawned successfully.
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:04:26 user nova-compute[75235]: INFO nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-1d9e1944-c2ea-4288-9391-0c4a162e4972 req-5f715510-c58c-49b3-b896-2f22fdb0b48e service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d9e1944-c2ea-4288-9391-0c4a162e4972 req-5f715510-c58c-49b3-b896-2f22fdb0b48e service nova] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d9e1944-c2ea-4288-9391-0c4a162e4972 req-5f715510-c58c-49b3-b896-2f22fdb0b48e service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1d9e1944-c2ea-4288-9391-0c4a162e4972 req-5f715510-c58c-49b3-b896-2f22fdb0b48e service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-1d9e1944-c2ea-4288-9391-0c4a162e4972 req-5f715510-c58c-49b3-b896-2f22fdb0b48e service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] No waiting events found dispatching network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:26 user nova-compute[75235]: WARNING nova.compute.manager [req-1d9e1944-c2ea-4288-9391-0c4a162e4972 req-5f715510-c58c-49b3-b896-2f22fdb0b48e service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received unexpected event network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d for instance with vm_state building and task_state spawning.
Nov 29 19:04:26 user nova-compute[75235]: INFO nova.compute.manager [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Took 6.15 seconds to build instance.
Nov 29 19:04:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7c1b2dd0-eba3-47a8-a05b-bc28ecbfa215 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.258s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:40 user nova-compute[75235]: INFO nova.compute.manager [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Terminating instance
Nov 29 19:04:40 user nova-compute[75235]: DEBUG nova.compute.manager [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-55abacd2-f89a-4057-91ea-a53632db801b req-35ff1b14-9a48-448e-9ff2-b4c69e712241 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-vif-unplugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55abacd2-f89a-4057-91ea-a53632db801b req-35ff1b14-9a48-448e-9ff2-b4c69e712241 service nova] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55abacd2-f89a-4057-91ea-a53632db801b req-35ff1b14-9a48-448e-9ff2-b4c69e712241 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55abacd2-f89a-4057-91ea-a53632db801b req-35ff1b14-9a48-448e-9ff2-b4c69e712241 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-55abacd2-f89a-4057-91ea-a53632db801b req-35ff1b14-9a48-448e-9ff2-b4c69e712241 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] No waiting events found dispatching network-vif-unplugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-55abacd2-f89a-4057-91ea-a53632db801b req-35ff1b14-9a48-448e-9ff2-b4c69e712241 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-vif-unplugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Instance destroyed successfully.
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.objects.instance [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lazy-loading 'resources' on Instance uuid 0f6193ce-63f6-4a8a-a527-c2fd41cc178b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1770582735',display_name='tempest-VolumesAssistedSnapshotsTest-server-1770582735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1770582735',id=9,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmE0BQc4SNaQdNHBUDVYmzOWBarE560r1d8zzfSQAtnXCBPhpcHRdaoTEI3a4FZerIThHHvE1k04pQ74NmZTWo0V6Qsul/51KBnQkUtQkKpHvj7OXpAePyofj8jrK9TTg==',key_name='tempest-keypair-251671915',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bab1863bb1b4b25b88f78ea64872054',ramdisk_id='',reservation_id='r-d20bq9me',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-113932405',owner_user_name='tempest-VolumesAssistedSnapshotsTest-113932405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f369822d9f140079b7a66196c1f5796',uuid=0f6193ce-63f6-4a8a-a527-c2fd41cc178b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Converting VIF {"id": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "address": "fa:16:3e:67:b8:9d", "network": {"id": "a5029e1b-edc4-4d16-9f55-ea20783db1dd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2114710291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bab1863bb1b4b25b88f78ea64872054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b9c347b-c8", "ovs_interfaceid": "0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG os_vif [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b9c347b-c8, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f90e844b-5724-41eb-9c5c-80cfd961b25d) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:41 user nova-compute[75235]: INFO os_vif [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:b8:9d,bridge_name='br-int',has_traffic_filtering=True,id=0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af,network=Network(a5029e1b-edc4-4d16-9f55-ea20783db1dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b9c347b-c8')
Nov 29 19:04:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Deleting instance files /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b_del
Nov 29 19:04:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Deletion of /opt/stack/data/nova/instances/0f6193ce-63f6-4a8a-a527-c2fd41cc178b_del complete
Nov 29 19:04:41 user nova-compute[75235]: INFO nova.compute.manager [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 19:04:41 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:04:41 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:04:42 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:42 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Took 0.94 seconds to deallocate network for instance.
Nov 29 19:04:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:42 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:43 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Deleted allocations for instance 0f6193ce-63f6-4a8a-a527-c2fd41cc178b
Nov 29 19:04:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-94d9ebce-ba83-45a4-bf4a-faeeb883dd15 tempest-VolumesAssistedSnapshotsTest-113932405 tempest-VolumesAssistedSnapshotsTest-113932405-project-member] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] Acquiring lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] Lock "0f6193ce-63f6-4a8a-a527-c2fd41cc178b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] No waiting events found dispatching network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:43 user nova-compute[75235]: WARNING nova.compute.manager [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received unexpected event network-vif-plugged-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af for instance with vm_state deleted and task_state None.
Nov 29 19:04:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-94e1bffe-2966-4f8b-8c61-958dd760f658 req-f7429e97-4cde-49a7-8b63-1a0eab779bc5 service nova] [instance: 0f6193ce-63f6-4a8a-a527-c2fd41cc178b] Received event network-vif-deleted-0b9c347b-c8d6-4dda-af0e-9c1d7eb7a5af {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:47 user nova-compute[75235]: INFO nova.compute.manager [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Terminating instance
Nov 29 19:04:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-a3a3670c-a809-4cc8-a19c-6c40058af599 req-84b91af7-44a4-4c0b-bda4-9861e47cc08a service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-unplugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a3a3670c-a809-4cc8-a19c-6c40058af599 req-84b91af7-44a4-4c0b-bda4-9861e47cc08a service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a3a3670c-a809-4cc8-a19c-6c40058af599 req-84b91af7-44a4-4c0b-bda4-9861e47cc08a service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a3a3670c-a809-4cc8-a19c-6c40058af599 req-84b91af7-44a4-4c0b-bda4-9861e47cc08a service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-a3a3670c-a809-4cc8-a19c-6c40058af599 req-84b91af7-44a4-4c0b-bda4-9861e47cc08a service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-unplugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-a3a3670c-a809-4cc8-a19c-6c40058af599 req-84b91af7-44a4-4c0b-bda4-9861e47cc08a service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-unplugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Instance destroyed successfully.
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lazy-loading 'resources' on Instance uuid d7e65309-b31e-4e11-bc9c-495c13d276bf {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-285421719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-285421719',id=7,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdPTCPzAsZbLWeP4/hZSc4+kUfIwBBEhSQEtUIPRaENF5tuj6OgXNuzWatdZ6vPV2tY8sCGx8HhgQ+4TVg9Xf0gP0W14B67B6cYYa9/2U+z00aThxdSR3me8aBlhKpL6Q==',key_name='tempest-keypair-1659301457',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='749fed6b75994169b86c6e7cf2fe8603',ramdisk_id='',reservation_id='r-4j0kmfj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1605261122',owner_user_name='tempest-TaggedAttachmentsTest-1605261122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f21971b2c04c03922cca2bd064cc4c',uuid=d7e65309-b31e-4e11-bc9c-495c13d276bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converting VIF {"id": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "address": "fa:16:3e:5d:6c:67", "network": {"id": "169fda59-ed4e-4413-b4d4-d08d1a03a1c8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-719833795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "749fed6b75994169b86c6e7cf2fe8603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1fd2ee-3e", "ovs_interfaceid": "5b1fd2ee-3e0c-4951-8909-25b853d04b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG os_vif [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b1fd2ee-3e, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36f1f3af-be40-4f83-b7b4-319400ac0c67) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:48 user nova-compute[75235]: INFO os_vif [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6c:67,bridge_name='br-int',has_traffic_filtering=True,id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c,network=Network(169fda59-ed4e-4413-b4d4-d08d1a03a1c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1fd2ee-3e')
Nov 29 19:04:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Deleting instance files /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf_del
Nov 29 19:04:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Deletion of /opt/stack/data/nova/instances/d7e65309-b31e-4e11-bc9c-495c13d276bf_del complete
Nov 29 19:04:48 user nova-compute[75235]: INFO nova.compute.manager [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-087dadbb-ad10-4c5d-ac03-5db1f3b0d709 req-34076e03-2bcd-4a5d-8e74-7929b15235d3 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-deleted-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:49 user nova-compute[75235]: INFO nova.compute.manager [req-087dadbb-ad10-4c5d-ac03-5db1f3b0d709 req-34076e03-2bcd-4a5d-8e74-7929b15235d3 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Neutron deleted interface 5b1fd2ee-3e0c-4951-8909-25b853d04b1c; detaching it from the instance and deleting it from the info cache
Nov 29 19:04:49 user nova-compute[75235]: DEBUG nova.network.neutron [req-087dadbb-ad10-4c5d-ac03-5db1f3b0d709 req-34076e03-2bcd-4a5d-8e74-7929b15235d3 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:49 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Took 1.24 seconds to deallocate network for instance.
Nov 29 19:04:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-087dadbb-ad10-4c5d-ac03-5db1f3b0d709 req-34076e03-2bcd-4a5d-8e74-7929b15235d3 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Detach interface failed, port_id=5b1fd2ee-3e0c-4951-8909-25b853d04b1c, reason: Instance d7e65309-b31e-4e11-bc9c-495c13d276bf could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-af027f8e-c196-4856-96db-77705aec7b02 req-2dd657c6-dc08-435c-9b27-e0488fe56472 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received event network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-af027f8e-c196-4856-96db-77705aec7b02 req-2dd657c6-dc08-435c-9b27-e0488fe56472 service nova] Acquiring lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-af027f8e-c196-4856-96db-77705aec7b02 req-2dd657c6-dc08-435c-9b27-e0488fe56472 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-af027f8e-c196-4856-96db-77705aec7b02 req-2dd657c6-dc08-435c-9b27-e0488fe56472 service nova] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-af027f8e-c196-4856-96db-77705aec7b02 req-2dd657c6-dc08-435c-9b27-e0488fe56472 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] No waiting events found dispatching network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:50 user nova-compute[75235]: WARNING nova.compute.manager [req-af027f8e-c196-4856-96db-77705aec7b02 req-2dd657c6-dc08-435c-9b27-e0488fe56472 service nova] [instance: d7e65309-b31e-4e11-bc9c-495c13d276bf] Received unexpected event network-vif-plugged-5b1fd2ee-3e0c-4951-8909-25b853d04b1c for instance with vm_state deleted and task_state None.
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:50 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Deleted allocations for instance d7e65309-b31e-4e11-bc9c-495c13d276bf
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ead4f558-599b-457a-9243-0e63bcdbe590 tempest-TaggedAttachmentsTest-1605261122 tempest-TaggedAttachmentsTest-1605261122-project-member] Lock "d7e65309-b31e-4e11-bc9c-495c13d276bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.043s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid 'd7e65309-b31e-4e11-bc9c-495c13d276bf' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd7e65309-b31e-4e11-bc9c-495c13d276bf' (instance-00000007)
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:04:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:04:51 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:04:51 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=25.482444763183594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance aa2da6c4-f2d2-4598-9113-122b3ca34133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 05533a2c-8f8e-4bfd-8b36-92470a10d5e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:04:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'flavor' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-changed-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing instance network info cache due to event network-changed-4188ed56-cc18-4a6e-982d-7829f4bdcc6c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] Acquiring lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] Acquired lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Refreshing network info cache for port 4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:52 user nova-compute[75235]: INFO nova.compute.manager [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Attaching volume c768b3db-abf8-4ab8-b2d4-06a521245d65 to /dev/vdb
Nov 29 19:04:52 user nova-compute[75235]: DEBUG os_brick.utils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed33a80-0c9f-48b5-bc21-479289d4daf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f82d9b2-8a15-4a31-8f0e-09bfba3eaa48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbbe290-9889-4794-ac30-aae53e072d4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c9e75c-2f0c-4819-9a2e-fb9baf0f58ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:04:52 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:04:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac7743-edb0-4c80-b6e7-62a22e8b0932]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG os_brick.utils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:04:52 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating existing volume attachment record: 0477a356-d176-49b6-a703-6f6a9b961f46 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG nova.network.neutron [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updated VIF entry in instance network info cache for port 4188ed56-cc18-4a6e-982d-7829f4bdcc6c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG nova.network.neutron [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-460618df-3a29-4d42-9f5b-78d078d5e52b req-1c322317-de59-4a16-a6c0-da705f8f1434 service nova] Releasing lock "refresh_cache-6a281fe7-91eb-413d-bbbf-eefe229195a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:04:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:55 user nova-compute[75235]: INFO nova.compute.manager [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Unshelving
Nov 29 19:04:55 user nova-compute[75235]: INFO nova.virt.block_device [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Booting with volume 2c6b30c1-aadb-444b-b17e-1c01b3e269a3 at /dev/vdc
Nov 29 19:04:55 user nova-compute[75235]: DEBUG os_brick.utils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23a114f-282d-41e7-950a-84424faf3a29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd894df-280e-42b0-ad61-67183f98dc9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a0c686-c635-49f2-aaa7-823914f8afb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513963a-29d5-45ac-b728-a35c692b15f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:04:55 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa48c2a1-8e20-4a64-a38b-7e0a55c517fc]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG os_brick.utils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating existing volume attachment record: bbd2092a-b57e-4ab9-9234-6e73ca9b9c2a {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:04:55 user nova-compute[75235]: INFO nova.compute.claims [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Claim successful on node user
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:55 user nova-compute[75235]: INFO nova.compute.manager [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Terminating instance
Nov 29 19:04:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-a28f72d0-57d6-46ce-85c4-2fb84e85541e req-638e6515-879d-4b6f-af29-61454a27b84b service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a28f72d0-57d6-46ce-85c4-2fb84e85541e req-638e6515-879d-4b6f-af29-61454a27b84b service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a28f72d0-57d6-46ce-85c4-2fb84e85541e req-638e6515-879d-4b6f-af29-61454a27b84b service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a28f72d0-57d6-46ce-85c4-2fb84e85541e req-638e6515-879d-4b6f-af29-61454a27b84b service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-a28f72d0-57d6-46ce-85c4-2fb84e85541e req-638e6515-879d-4b6f-af29-61454a27b84b service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-a28f72d0-57d6-46ce-85c4-2fb84e85541e req-638e6515-879d-4b6f-af29-61454a27b84b service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-54f0451c-1bb4-4766-bfc6-475c36d5682f req-a0ba01f1-d22c-4926-b968-4068eaa1576d service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-54f0451c-1bb4-4766-bfc6-475c36d5682f req-a0ba01f1-d22c-4926-b968-4068eaa1576d service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-54f0451c-1bb4-4766-bfc6-475c36d5682f req-a0ba01f1-d22c-4926-b968-4068eaa1576d service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-54f0451c-1bb4-4766-bfc6-475c36d5682f req-a0ba01f1-d22c-4926-b968-4068eaa1576d service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-54f0451c-1bb4-4766-bfc6-475c36d5682f req-a0ba01f1-d22c-4926-b968-4068eaa1576d service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-54f0451c-1bb4-4766-bfc6-475c36d5682f req-a0ba01f1-d22c-4926-b968-4068eaa1576d service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.policy [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d98bb13233f447295cf54cb5b1574e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dafa45545c46169abd1cad11ba15cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:04:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Creating image(s)
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.277s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk 1073741824" returned: 0 in 0.059s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.232s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:57 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Instance destroyed successfully.
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lazy-loading 'resources' on Instance uuid 6a281fe7-91eb-413d-bbbf-eefe229195a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4188ed56-cc, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Cannot resize image /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Ensure instance console log exists: /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1755b983-59fd-4e17-b052-46d1aee6a529) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:cc:a6,bridge_name='br-int',has_traffic_filtering=True,id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c,network=Network(71659c26-cced-4ac2-8368-419e656b537d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4188ed56-cc')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e624b2a-3e, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e645523-0d18-4f5d-bdc3-c90daee91d87) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0e:65,bridge_name='br-int',has_traffic_filtering=True,id=6e624b2a-3e38-49ff-815c-5d3dabb050b4,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e624b2a-3e')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dcb6032-2d, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90cb7a75-39e7-4cbd-bd1c-56e48562e7cc) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:7d:5b,bridge_name='br-int',has_traffic_filtering=True,id=0dcb6032-2d17-488b-90d0-410caec37df5,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0dcb6032-2d')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45eda44c-c6, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9c78119-0b79-4db1-8b96-2b53b214acb0) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-4282a31e-6e84-4926-8ab8-8119a9a3e314 req-9dbe42d3-98f1-4dbd-a2fc-997c54b9bb45 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4282a31e-6e84-4926-8ab8-8119a9a3e314 req-9dbe42d3-98f1-4dbd-a2fc-997c54b9bb45 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4282a31e-6e84-4926-8ab8-8119a9a3e314 req-9dbe42d3-98f1-4dbd-a2fc-997c54b9bb45 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4282a31e-6e84-4926-8ab8-8119a9a3e314 req-9dbe42d3-98f1-4dbd-a2fc-997c54b9bb45 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-4282a31e-6e84-4926-8ab8-8119a9a3e314 req-9dbe42d3-98f1-4dbd-a2fc-997c54b9bb45 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:58 user nova-compute[75235]: WARNING nova.compute.manager [req-4282a31e-6e84-4926-8ab8-8119a9a3e314 req-9dbe42d3-98f1-4dbd-a2fc-997c54b9bb45 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-4188ed56-cc18-4a6e-982d-7829f4bdcc6c for instance with vm_state active and task_state deleting.
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b2:8d,bridge_name='br-int',has_traffic_filtering=True,id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45eda44c-c6')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d466bfe-13, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=814053eb-0ec4-4268-a391-3457ac5ccdfd) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:44:c1,bridge_name='br-int',has_traffic_filtering=True,id=5d466bfe-13b0-41fe-ba7e-34231525e916,network=Network(64ad11f7-1efd-4084-89f9-ad094d0e3275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d466bfe-13')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "a04a5197-434c-404c-a405-05d55e00334e", "address": "fa:16:3e:5a:d9:a8", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04a5197-43", "ovs_interfaceid": "a04a5197-434c-404c-a405-05d55e00334e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa04a5197-43, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5605bc41-2986-4d5f-93d5-1e71309e84bd) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d9:a8,bridge_name='br-int',has_traffic_filtering=True,id=a04a5197-434c-404c-a405-05d55e00334e,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04a5197-43')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-771915300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-771915300',id=11,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRYBJQmeYvV/nyignVB++SyiNcIKCYm9tNBh3B/GwZ/ygG7YDD3Gzcpm58xvifpGUtYhoNrFrjxK9/6yV8ekvFiqFavq7HSh8GAd8IZCbNxbSh23pwQ0Hzui2Tj4lW5g==',key_name='tempest-keypair-1304763111',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1626d60defd14c4fbdd1b3cb95f91dc1',ramdisk_id='',reservation_id='r-9zmrqb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397264967',owner_user_name='tempest-TaggedBootDevicesTest-397264967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a51857517d6942179e224f4a2d26e797',uuid=6a281fe7-91eb-413d-bbbf-eefe229195a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converting VIF {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0ed2b87-3c, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6af4fc2f-1fec-4093-9ce1-f28c23d80109) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:04:58 user nova-compute[75235]: INFO os_vif [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:19:87,bridge_name='br-int',has_traffic_filtering=True,id=e0ed2b87-3c44-4a10-b698-788b87cbedf6,network=Network(7629e646-9ab3-4a3c-b3a4-4c0e0512b8af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ed2b87-3c')
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFvRPSAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:04:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55f03cc-2bef-455f-b188-79181dd0e0d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:04:58 user nova-compute[75235]: No targets found.
Nov 29 19:04:58 user nova-compute[75235]: iSNS:
Nov 29 19:04:58 user nova-compute[75235]: No targets found.
Nov 29 19:04:58 user nova-compute[75235]: STATIC:
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: FIRMWARE:
Nov 29 19:04:58 user nova-compute[75235]: No targets found.
Nov 29 19:04:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:04:58 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:04:58 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8daa72-9d5a-488e-8de5-f710c2c2f834]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eefd71c-5587-452b-9372-d6f42e349877]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:58 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565052e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7099b3b-6dc2-4943-a0c8-c99bca4e9b2d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[58050434-df9e-4a0e-9e8c-9615b74a854e]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547c63e-53b7-4b3d-a92a-67834fbea1a2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edde044-3a3f-4f53-8bdf-b639b9f8d9ef]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6632da-97ae-48f4-a9b3-402d809909f1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca10a9-7aa3-4068-b1f2-71cb7432a4ca]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260]
Nov 29 19:04:58 user nova-compute[75235]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439, portal: 172.16.0.220,3260] successful.
Nov 29 19:04:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4052f7-eb63-4b04-ae7b-a0022806d439 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf92e3-646b-4aca-9402-97b1c2e93c10]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== disconnect_volume: return (394ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCBcTsIE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:04:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:58 user nova-compute[75235]: WARNING nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-6e624b2a-3e38-49ff-815c-5d3dabb050b4 for instance with vm_state active and task_state deleting.
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:58 user nova-compute[75235]: WARNING nova.compute.manager [req-b8857ab5-d71f-4443-92bc-3326fc32a46a req-1985ccd4-c190-46bb-8156-3e7ebd9e8c84 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-45eda44c-c6da-4458-96c8-dc8eeb11d7bc for instance with vm_state active and task_state deleting.
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2b11e-332f-48d3-b5aa-1cd1d9429287]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:04:58 user nova-compute[75235]: No targets found.
Nov 29 19:04:58 user nova-compute[75235]: iSNS:
Nov 29 19:04:58 user nova-compute[75235]: No targets found.
Nov 29 19:04:58 user nova-compute[75235]: STATIC:
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:04:58 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:58 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:58 user nova-compute[75235]: FIRMWARE:
Nov 29 19:04:58 user nova-compute[75235]: No targets found.
Nov 29 19:04:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:04:58 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:04:58 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[07798bb0-4507-4dc0-ac77-4601f6c9ea60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c08ed0-3313-4412-a40b-0c30fb809bc6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56503ff760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eebf86d-d22c-4fa7-8521-083ad8abbf94]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91821b-b463-4e40-973b-4cd99b346292]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e8c0e5-96c4-48c0-8b34-1a3a6eee54ef]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[63844f98-71c0-48f2-8182-464bb80bb08a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f22aeac-499f-41f7-aa87-484cbab36e1b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Successfully created port: f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2d052-1711-46de-a2c4-c3c238f40765]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260]
Nov 29 19:04:59 user nova-compute[75235]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e, portal: 172.16.0.220,3260] successful.
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb8e0671-cbea-45ab-9711-3ed30315b46e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b23de48-e456-4dd8-abc8-d1550e3e97e3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== disconnect_volume: return (404ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GxWRqjpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:04:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d455c-c374-4c85-bba6-55f80d71f3a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:04:59 user nova-compute[75235]: No targets found.
Nov 29 19:04:59 user nova-compute[75235]: iSNS:
Nov 29 19:04:59 user nova-compute[75235]: No targets found.
Nov 29 19:04:59 user nova-compute[75235]: STATIC:
Nov 29 19:04:59 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:04:59 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:59 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:59 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb
Nov 29 19:04:59 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:59 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:59 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:04:59 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:59 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:59 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:04:59 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:04:59 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:04:59 user nova-compute[75235]: FIRMWARE:
Nov 29 19:04:59 user nova-compute[75235]: No targets found.
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:04:59 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:04:59 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa710b4-5f47-43d3-b65d-fd63197c2e0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e36b14-d71f-44df-bfba-a059079f9f3a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb (non-flash)
Nov 29 19:04:59 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56503ff760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb'): ({'sdg'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Removing single pathed devices sdg {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cec3c0-50aa-4ff6-aab6-bf05cfb78410]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd7111-3783-47bb-8799-cd4eb59a4be3]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Flushing IO for device /dev/sdg {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c95d60-aaa3-4f08-9a0f-5921c9d44d52]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503f084-fe77-4b02-a7e0-d1f80d49e21d]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] SCSI volumes sdg have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9a07e-503b-4397-8f4f-5eaaadc3007f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120d30f-9990-4481-bf5c-ef2e47d1124e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260]
Nov 29 19:04:59 user nova-compute[75235]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb, portal: 172.16.0.220,3260] successful.
Nov 29 19:04:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d02d2a9a-a2d0-4665-8b26-5e745f8031bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de0acb-5758-4cea-9d64-38c910a2866d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] <== disconnect_volume: return (376ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:04:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Deleting instance files /opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8_del
Nov 29 19:04:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Deletion of /opt/stack/data/nova/instances/6a281fe7-91eb-413d-bbbf-eefe229195a8_del complete
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e2f671e-d4ba-4fd7-9154-90998711cdd2 req-6ce51c72-fa85-4048-9d9a-0c909cb774d3 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e2f671e-d4ba-4fd7-9154-90998711cdd2 req-6ce51c72-fa85-4048-9d9a-0c909cb774d3 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e2f671e-d4ba-4fd7-9154-90998711cdd2 req-6ce51c72-fa85-4048-9d9a-0c909cb774d3 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e2f671e-d4ba-4fd7-9154-90998711cdd2 req-6ce51c72-fa85-4048-9d9a-0c909cb774d3 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e2f671e-d4ba-4fd7-9154-90998711cdd2 req-6ce51c72-fa85-4048-9d9a-0c909cb774d3 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e2f671e-d4ba-4fd7-9154-90998711cdd2 req-6ce51c72-fa85-4048-9d9a-0c909cb774d3 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-0dcb6032-2d17-488b-90d0-410caec37df5 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:04:59 user nova-compute[75235]: INFO nova.compute.manager [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Took 4.01 seconds to destroy the instance on the hypervisor.
Nov 29 19:04:59 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:04:59 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Successfully updated port: f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquired lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-changed-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Refreshing instance network info cache due to event network-changed-f8907cc3-5fa0-46bf-860f-250eaa8181e8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] Acquiring lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating instance_info_cache with network_info: [{"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Releasing lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance network_info: |[{"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] Acquired lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.neutron [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Refreshing network info cache for port f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Start _get_guest_xml network_info=[{"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:05:00 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:00 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-452764783',display_name='tempest-tempest.common.compute-instance-452764783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-452764783',id=15,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhlCj/4Wb1/znNidthF7GTl7ZFQnQRIHHkVL4+OP2nWB9AGzxFnIF1SOQbUUzDG+crOoTUDPSmrLhE0Rk3obbMmRv6oSwbsUt4imU4nZnxpr11Me+oK5jggNMnTB7aikA==',key_name='tempest-keypair-1677183937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-qxoxu2ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=0e7eb484-033e-4a7a-a259-a183e78a6b96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.objects.instance [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:05:00 user nova-compute[75235]:   <uuid>0e7eb484-033e-4a7a-a259-a183e78a6b96</uuid>
Nov 29 19:05:00 user nova-compute[75235]:   <name>instance-0000000f</name>
Nov 29 19:05:00 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:05:00 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:05:00 user nova-compute[75235]:   <metadata>
Nov 29 19:05:00 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:05:00 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:05:00 user nova-compute[75235]:       <nova:name>tempest-tempest.common.compute-instance-452764783</nova:name>
Nov 29 19:05:00 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:05:00</nova:creationTime>
Nov 29 19:05:00 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:05:00 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:05:00 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:05:00 user nova-compute[75235]:       <nova:owner>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:user uuid="1d98bb13233f447295cf54cb5b1574e8">tempest-ServerActionsTestOtherA-279549641-project-member</nova:user>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:project uuid="68dafa45545c46169abd1cad11ba15cc">tempest-ServerActionsTestOtherA-279549641</nova:project>
Nov 29 19:05:00 user nova-compute[75235]:       </nova:owner>
Nov 29 19:05:00 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:05:00 user nova-compute[75235]:       <nova:ports>
Nov 29 19:05:00 user nova-compute[75235]:         <nova:port uuid="f8907cc3-5fa0-46bf-860f-250eaa8181e8">
Nov 29 19:05:00 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 19:05:00 user nova-compute[75235]:         </nova:port>
Nov 29 19:05:00 user nova-compute[75235]:       </nova:ports>
Nov 29 19:05:00 user nova-compute[75235]:     </nova:instance>
Nov 29 19:05:00 user nova-compute[75235]:   </metadata>
Nov 29 19:05:00 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:05:00 user nova-compute[75235]:     <system>
Nov 29 19:05:00 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:05:00 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:05:00 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:05:00 user nova-compute[75235]:       <entry name="serial">0e7eb484-033e-4a7a-a259-a183e78a6b96</entry>
Nov 29 19:05:00 user nova-compute[75235]:       <entry name="uuid">0e7eb484-033e-4a7a-a259-a183e78a6b96</entry>
Nov 29 19:05:00 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:05:00 user nova-compute[75235]:     </system>
Nov 29 19:05:00 user nova-compute[75235]:   </sysinfo>
Nov 29 19:05:00 user nova-compute[75235]:   <os>
Nov 29 19:05:00 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:05:00 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:05:00 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:05:00 user nova-compute[75235]:   </os>
Nov 29 19:05:00 user nova-compute[75235]:   <features>
Nov 29 19:05:00 user nova-compute[75235]:     <acpi/>
Nov 29 19:05:00 user nova-compute[75235]:     <apic/>
Nov 29 19:05:00 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:05:00 user nova-compute[75235]:   </features>
Nov 29 19:05:00 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:05:00 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:05:00 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:05:00 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:05:00 user nova-compute[75235]:   </clock>
Nov 29 19:05:00 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:05:00 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:05:00 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:05:00 user nova-compute[75235]:   </cpu>
Nov 29 19:05:00 user nova-compute[75235]:   <devices>
Nov 29 19:05:00 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:05:00 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:05:00 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk"/>
Nov 29 19:05:00 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:05:00 user nova-compute[75235]:     </disk>
Nov 29 19:05:00 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:05:00 user nova-compute[75235]:       <mac address="fa:16:3e:cd:47:86"/>
Nov 29 19:05:00 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:00 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:05:00 user nova-compute[75235]:       <target dev="tapf8907cc3-5f"/>
Nov 29 19:05:00 user nova-compute[75235]:     </interface>
Nov 29 19:05:00 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:05:00 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/console.log" append="off"/>
Nov 29 19:05:00 user nova-compute[75235]:     </serial>
Nov 29 19:05:00 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:05:00 user nova-compute[75235]:     <video>
Nov 29 19:05:00 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:00 user nova-compute[75235]:     </video>
Nov 29 19:05:00 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:05:00 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:05:00 user nova-compute[75235]:     </rng>
Nov 29 19:05:00 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:05:00 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:05:00 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:05:00 user nova-compute[75235]:     </memballoon>
Nov 29 19:05:00 user nova-compute[75235]:   </devices>
Nov 29 19:05:00 user nova-compute[75235]: </domain>
Nov 29 19:05:00 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-452764783',display_name='tempest-tempest.common.compute-instance-452764783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-452764783',id=15,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhlCj/4Wb1/znNidthF7GTl7ZFQnQRIHHkVL4+OP2nWB9AGzxFnIF1SOQbUUzDG+crOoTUDPSmrLhE0Rk3obbMmRv6oSwbsUt4imU4nZnxpr11Me+oK5jggNMnTB7aikA==',key_name='tempest-keypair-1677183937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-qxoxu2ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=0e7eb484-033e-4a7a-a259-a183e78a6b96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG os_vif [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60b75606-3346-5dfd-a335-8b82cb7d603a', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8907cc3-5f, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8907cc3-5f, col_values=(('qos', UUID('0a460632-b6a5-4f9e-a499-aa1fc3b428a0')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8907cc3-5f, col_values=(('external_ids', {'iface-id': 'f8907cc3-5fa0-46bf-860f-250eaa8181e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:47:86', 'vm-uuid': '0e7eb484-033e-4a7a-a259-a183e78a6b96'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:00 user nova-compute[75235]: INFO os_vif [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f')
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No VIF found with MAC fa:16:3e:cd:47:86, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updated VIF entry in instance network info cache for port f8907cc3-5fa0-46bf-860f-250eaa8181e8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating instance_info_cache with network_info: [{"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8f93b6f-8bf3-43d4-b9c3-162badab733e req-9094e585-8681-4a8c-8fff-e5cc59792295 service nova] Releasing lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-a04a5197-434c-404c-a405-05d55e00334e for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-changed-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing instance network info cache due to event network-changed-86cc49ca-6749-42d2-baf3-d5612b552fb3. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Acquiring lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Acquired lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Refreshing network info cache for port 86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updated VIF entry in instance network info cache for port 86cc49ca-6749-42d2-baf3-d5612b552fb3. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:05:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Releasing lock "refresh_cache-31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:02 user nova-compute[75235]: WARNING nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-a04a5197-434c-404c-a405-05d55e00334e for instance with vm_state active and task_state deleting.
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:02 user nova-compute[75235]: WARNING nova.compute.manager [req-4045f627-558d-4dba-b41e-0cb5e2d2554b req-61c68e96-2cb0-4130-98cb-caebcb262881 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-e0ed2b87-3c44-4a10-b698-788b87cbedf6 for instance with vm_state active and task_state deleting.
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:02 user nova-compute[75235]: WARNING nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-0dcb6032-2d17-488b-90d0-410caec37df5 for instance with vm_state active and task_state deleting.
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-unplugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-unplugged-5d466bfe-13b0-41fe-ba7e-34231525e916 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Acquiring lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] No waiting events found dispatching network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:02 user nova-compute[75235]: WARNING nova.compute.manager [req-45fae7c3-e878-49db-bdb6-0ba45fc8dc5f req-1b8d9fef-fdf3-4eb2-ba37-af879fffa7c5 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received unexpected event network-vif-plugged-5d466bfe-13b0-41fe-ba7e-34231525e916 for instance with vm_state active and task_state deleting.
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYmwSJBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:02 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:02 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:02 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4919363-7362-4fb9-8c44-93aa0388bfb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:05:02 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24dda7f-65b2-44a3-a3e6-003abd009f6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65] added
Nov 29 19:05:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e056184-61ff-41cb-984b-17cc510406dd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a36d1a-0c5d-4b0b-aca6-e3a95c9e04d6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYmwSJBC {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYmwSJBC" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22f770-8331-4b72-a43d-1fb4d5052903]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYmwSJBC'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be54de8-0943-442d-95a2-e13740a52012]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5585a6e-3967-4473-8c6e-ef94034246d8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:02 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:05:02 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:02 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:05:02 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:02 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3bb2e5-58d0-4d1a-b05d-3058197d77a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260]
Nov 29 19:05:03 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260] successful.
Nov 29 19:05:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5879399-7d25-4a58-b793-36f7fcdd81d8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd16ced-4f7b-46da-970e-d44c5781529a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:03 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:03 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:05:03 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:03 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:03 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:05:03 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:03 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5479a56c-dbb7-4212-a31e-97aed24fda63]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:03 user nova-compute[75235]: INFO nova.compute.manager [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Terminating instance
Nov 29 19:05:03 user nova-compute[75235]: DEBUG nova.compute.manager [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-0fea7b02-3ef5-469f-bf2c-594eb40bad3b req-73c7e12c-f3a2-4b5e-8c5a-ea07ba555d45 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fea7b02-3ef5-469f-bf2c-594eb40bad3b req-73c7e12c-f3a2-4b5e-8c5a-ea07ba555d45 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fea7b02-3ef5-469f-bf2c-594eb40bad3b req-73c7e12c-f3a2-4b5e-8c5a-ea07ba555d45 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fea7b02-3ef5-469f-bf2c-594eb40bad3b req-73c7e12c-f3a2-4b5e-8c5a-ea07ba555d45 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-0fea7b02-3ef5-469f-bf2c-594eb40bad3b req-73c7e12c-f3a2-4b5e-8c5a-ea07ba555d45 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:03 user nova-compute[75235]: WARNING nova.compute.manager [req-0fea7b02-3ef5-469f-bf2c-594eb40bad3b req-73c7e12c-f3a2-4b5e-8c5a-ea07ba555d45 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state building and task_state spawning.
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-e155cf54-c03c-4c98-862f-ba6254258d1a req-f544dde3-585f-4dc5-8bd2-7541daf498cd service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e155cf54-c03c-4c98-862f-ba6254258d1a req-f544dde3-585f-4dc5-8bd2-7541daf498cd service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e155cf54-c03c-4c98-862f-ba6254258d1a req-f544dde3-585f-4dc5-8bd2-7541daf498cd service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e155cf54-c03c-4c98-862f-ba6254258d1a req-f544dde3-585f-4dc5-8bd2-7541daf498cd service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-e155cf54-c03c-4c98-862f-ba6254258d1a req-f544dde3-585f-4dc5-8bd2-7541daf498cd service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-e155cf54-c03c-4c98-862f-ba6254258d1a req-f544dde3-585f-4dc5-8bd2-7541daf498cd service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYmwSJBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23631616630646164', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631616630646164', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'flavor' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:05:04 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:05:04 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:05:04 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:05:04 user nova-compute[75235]:   <serial>c768b3db-abf8-4ab8-b2d4-06a521245d65</serial>
Nov 29 19:05:04 user nova-compute[75235]: </disk>
Nov 29 19:05:04 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No VIF found with MAC fa:16:3e:fe:ec:c3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0d5d92ef-71b3-457a-878c-8302f32ea5ca tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.479s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance spawned successfully.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Instance destroyed successfully.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.objects.instance [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lazy-loading 'resources' on Instance uuid 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Took 8.41 seconds to spawn the instance on the hypervisor.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86cc49ca-67, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.compute.manager [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Took 9.71 seconds to build instance.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f3a6124-7198-4028-8bb7-cbd90c55c727) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59cf1b29-ef13-48b6-9fa7-e5c5480d1385 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.855s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: WARNING nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state active and task_state None.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-deleted-a04a5197-434c-404c-a405-05d55e00334e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Neutron deleted interface a04a5197-434c-404c-a405-05d55e00334e; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "address": "fa:16:3e:af:19:87", "network": {"id": "7629e646-9ab3-4a3c-b3a4-4c0e0512b8af", "bridge": "br-int", "label": "tempest-device-tagging-net2-1942168721", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ed2b87-3c", "ovs_interfaceid": "e0ed2b87-3c44-4a10-b698-788b87cbedf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:1d:e8,bridge_name='br-int',has_traffic_filtering=True,id=86cc49ca-6749-42d2-baf3-d5612b552fb3,network=Network(8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86cc49ca-67')
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2180ed4f-ef, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Detach interface failed, port_id=a04a5197-434c-404c-a405-05d55e00334e, reason: Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-deleted-e0ed2b87-3c44-4a10-b698-788b87cbedf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Neutron deleted interface e0ed2b87-3c44-4a10-b698-788b87cbedf6; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "address": "fa:16:3e:cd:b2:8d", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45eda44c-c6", "ovs_interfaceid": "45eda44c-c6da-4458-96c8-dc8eeb11d7bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Detach interface failed, port_id=e0ed2b87-3c44-4a10-b698-788b87cbedf6, reason: Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: WARNING nova.compute.manager [req-02d147ef-42f3-4072-a9e5-d25c6a866d7d req-adf58b29-d7d3-4c18-93b8-d6462ab1d30f service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-86cc49ca-6749-42d2-baf3-d5612b552fb3 for instance with vm_state active and task_state deleting.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7fbdc1c-7a41-441f-b7df-0d903ed8f93f) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4f:e7,bridge_name='br-int',has_traffic_filtering=True,id=2180ed4f-ef9b-478b-98d4-fc1191c8132f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2180ed4f-ef')
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa21488c6-77, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa489142-1f15-4e6e-a24b-a8c702b02065) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f7:f7,bridge_name='br-int',has_traffic_filtering=True,id=a21488c6-77a7-46f8-a4e1-4bafd95c87ec,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa21488c6-77')
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: WARNING nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-2180ed4f-ef9b-478b-98d4-fc1191c8132f for instance with vm_state active and task_state deleting.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: WARNING nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-a21488c6-77a7-46f8-a4e1-4bafd95c87ec for instance with vm_state active and task_state deleting.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-9d300876-7a9b-4756-b1a3-40118556fd87 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: WARNING nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-9d300876-7a9b-4756-b1a3-40118556fd87 for instance with vm_state active and task_state deleting.
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1ac3b36-a16a-4a7c-ab86-d79d0dd958d5 req-77144f1b-a4b1-435f-a8a8-ac7fe13e9c4b service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-78180abc-79e1-4b4f-bd98-3d77701f3863 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d300876-7a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=324eab3f-fc58-4052-9c13-2d59a5223b07) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.objects.instance [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'pci_requests' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.objects.instance [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'numa_topology' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c2:1b,bridge_name='br-int',has_traffic_filtering=True,id=9d300876-7a9b-4756-b1a3-40118556fd87,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d300876-7a')
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:05:05 user nova-compute[75235]: INFO nova.compute.claims [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Claim successful on node user
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2ed01a1-0a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a028eef-06bb-46cd-9eb8-92af54d24945) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:de:c3,bridge_name='br-int',has_traffic_filtering=True,id=a2ed01a1-0a46-453c-b542-37979837174f,network=Network(a117d47d-c4b1-420e-9577-672c0a3acb44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ed01a1-0a')
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bb8b3ee-5a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bb3a42a-0045-4172-9316-c252127e2720) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:3c:d9,bridge_name='br-int',has_traffic_filtering=True,id=8bb8b3ee-5a58-480c-b03c-87858cc2483a,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8b3ee-5a')
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T19:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-660231169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-660231169',id=12,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETZwelLVKkTMeXricXFpJOcLcq0uxkRLEQ/DZNksDSM/DUoqMccXlyJJjPy9tUg0Iyve+aA01kWk/FuIHL0pPuh3XHlpMjTskieHHo/BDvCmr5D2e4ihBxLbDYopV5vfA==',key_name='tempest-keypair-493353653',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b927f53f71b4768b4411cc6b9c46640',ramdisk_id='',reservation_id='r-0x8n3dmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1070290409',owner_user_name='tempest-TaggedBootDevicesTest_v242-1070290409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='164edb16c9004e418c0c8ca4988d9131',uuid=31eaaa64-f6cb-4e8a-bf81-d349cf72c34c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converting VIF {"id": "78180abc-79e1-4b4f-bd98-3d77701f3863", "address": "fa:16:3e:2a:7f:a4", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78180abc-79", "ovs_interfaceid": "78180abc-79e1-4b4f-bd98-3d77701f3863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78180abc-79, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fd0db7f-4d55-4637-89b3-eb7d640bdd7b) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: INFO nova.compute.manager [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Rescuing
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:05:06 user nova-compute[75235]: INFO os_vif [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7f:a4,bridge_name='br-int',has_traffic_filtering=True,id=78180abc-79e1-4b4f-bd98-3d77701f3863,network=Network(10d1c3bc-b054-486d-aa42-0328f693c4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78180abc-79')
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SrkpDsZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:06 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104f56f-9e04-42da-8467-fff2b2757423]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]: iSNS:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]: STATIC:
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: FIRMWARE:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:05:06 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:05:06 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f8acf-b6af-4f06-b9a0-6bd73896bc82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b820522-48a0-42d8-861d-ce7cc164c9ca]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c74d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82'): ({'sdf'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Removing single pathed devices sdf {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[96614630-1b21-457d-9f54-7c18522097c2]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c981bb-12c6-4eb3-849a-3807adbe8d8a]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Flushing IO for device /dev/sdf {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b84cc4-98bd-443a-b47d-333d97f1a93b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b824a6ad-f9fc-4ae6-9f34-7304b68e9d7c]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a896dd20-f8ab-4b31-b4b9-5952e5a4dfa4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[94225b91-661e-4dba-99a3-dac8ce77cf0c]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260]
Nov 29 19:05:06 user nova-compute[75235]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82, portal: 172.16.0.220,3260] successful.
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f3a1872-ae40-4504-a9a2-fe8bf37cdd82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f8a579-9ea5-43b9-9cb7-7e4302965efd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== disconnect_volume: return (352ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVukTMgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:06 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b4b702-9ace-46aa-8523-af88eae9ad32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]: iSNS:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]: STATIC:
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: FIRMWARE:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:05:06 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:05:06 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[69369b72-ed91-47bd-ad6f-b274621b69c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a40d3ba-8f17-4b5a-9c89-1066bca366db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5650517760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc9cff-d8f5-4289-af1f-05e70d393f15]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[56597c4e-2676-4d14-b93c-5d5f6c678485]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1c61ba-26a9-4fca-88ca-db1d4b1bc51a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6dc1fc-5878-4049-9196-63bc46578f74]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: INFO nova.network.neutron [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating port 62fcb2af-3273-4fdc-b68a-6c0492925844 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[69efc9a7-838e-49ba-ac7f-205144865a47]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf803041-48c6-4d54-9a38-693ec1aca2bf]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260]
Nov 29 19:05:06 user nova-compute[75235]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848, portal: 172.16.0.220,3260] successful.
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f9108c-4497-471c-a921-47252881f848 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd674fb3-f98a-4041-978b-f0f143c7a37a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== disconnect_volume: return (366ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zibUjvPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:06 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c4f04-e5d9-4b84-b177-baf6810487f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]: iSNS:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]: STATIC:
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:05:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:05:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:05:06 user nova-compute[75235]: FIRMWARE:
Nov 29 19:05:06 user nova-compute[75235]: No targets found.
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:05:06 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:05:06 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90efc7a-1acf-408b-8c2d-fa2826acc96d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a613933-7880-41b3-a6b0-4ae8cca90d4a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:06 user nova-compute[75235]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d (non-flash)
Nov 29 19:05:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5650517760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d'): ({'sdh'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Removing single pathed devices sdh {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fc2a65-5b05-481e-86fb-9402db191ed1]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa60b94-72a7-4ac5-b8d3-66dc24274839]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Flushing IO for device /dev/sdh {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05feb73-09bc-430c-a484-65ad47d0f47e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[93368aed-e3cc-44e7-b802-f0399a951d2f]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] SCSI volumes sdh have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd0060-1aa6-468b-b1e0-fa5ad42a6f55]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2de1d8-3461-4f29-9887-ac2df1350be1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260]
Nov 29 19:05:07 user nova-compute[75235]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d, portal: 172.16.0.220,3260] successful.
Nov 29 19:05:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7979675-b1f4-491c-83f7-075a6417de4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3d4ba6-7549-4e2b-8653-217839232a89]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] <== disconnect_volume: return (368ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Deleting instance files /opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c_del
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Deletion of /opt/stack/data/nova/instances/31eaaa64-f6cb-4e8a-bf81-d349cf72c34c_del complete
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.compute.manager [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Took 4.16 seconds to destroy the instance on the hypervisor.
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance destroyed successfully.
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Attempting a stable device rescue
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-a2ed01a1-0a46-453c-b542-37979837174f for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-deleted-45eda44c-c6da-4458-96c8-dc8eeb11d7bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Neutron deleted interface 45eda44c-c6da-4458-96c8-dc8eeb11d7bc; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "address": "fa:16:3e:f8:cc:a6", "network": {"id": "71659c26-cced-4ac2-8368-419e656b537d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1591140492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4188ed56-cc", "ovs_interfaceid": "4188ed56-cc18-4a6e-982d-7829f4bdcc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75235) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:05:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Creating image(s)
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "82ad7dbdf54d1f9dcb60c1006953c157d5f45e08" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "82ad7dbdf54d1f9dcb60c1006953c157d5f45e08" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Detach interface failed, port_id=45eda44c-c6da-4458-96c8-dc8eeb11d7bc, reason: Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:07 user nova-compute[75235]: WARNING nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-a2ed01a1-0a46-453c-b542-37979837174f for instance with vm_state active and task_state deleting.
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-unplugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-a43765ef-cf31-4a7d-ba0d-a7e5556f3bdc req-b9dbfa20-0ba5-45be-9740-f4681e3f10ee service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-unplugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-9e095148-9d09-47d1-99e4-f930e38347cf req-ef8bec03-c88f-4bfa-90c6-8ee24c7e4949 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9e095148-9d09-47d1-99e4-f930e38347cf req-ef8bec03-c88f-4bfa-90c6-8ee24c7e4949 service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9e095148-9d09-47d1-99e4-f930e38347cf req-ef8bec03-c88f-4bfa-90c6-8ee24c7e4949 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9e095148-9d09-47d1-99e4-f930e38347cf req-ef8bec03-c88f-4bfa-90c6-8ee24c7e4949 service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-9e095148-9d09-47d1-99e4-f930e38347cf req-ef8bec03-c88f-4bfa-90c6-8ee24c7e4949 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:07 user nova-compute[75235]: WARNING nova.compute.manager [req-9e095148-9d09-47d1-99e4-f930e38347cf req-ef8bec03-c88f-4bfa-90c6-8ee24c7e4949 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-78180abc-79e1-4b4f-bd98-3d77701f3863 for instance with vm_state active and task_state deleting.
Nov 29 19:05:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.part --force-share --output=json" returned: 0 in 0.235s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.virt.images [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] 7878e26e-c9b4-4aaa-8a27-1526a062683f was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.part /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-ab79a01e-cd0e-4123-bf64-90d5534b4948 req-1944dd4c-1727-40d1-b697-6e771ab1e79d service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ab79a01e-cd0e-4123-bf64-90d5534b4948 req-1944dd4c-1727-40d1-b697-6e771ab1e79d service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ab79a01e-cd0e-4123-bf64-90d5534b4948 req-1944dd4c-1727-40d1-b697-6e771ab1e79d service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ab79a01e-cd0e-4123-bf64-90d5534b4948 req-1944dd4c-1727-40d1-b697-6e771ab1e79d service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-ab79a01e-cd0e-4123-bf64-90d5534b4948 req-1944dd4c-1727-40d1-b697-6e771ab1e79d service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:09 user nova-compute[75235]: WARNING nova.compute.manager [req-ab79a01e-cd0e-4123-bf64-90d5534b4948 req-1944dd4c-1727-40d1-b697-6e771ab1e79d service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state active and task_state rescuing.
Nov 29 19:05:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.part /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.converted" returned: 0 in 0.495s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] Acquiring lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] No waiting events found dispatching network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:09 user nova-compute[75235]: WARNING nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received unexpected event network-vif-plugged-8bb8b3ee-5a58-480c-b03c-87858cc2483a for instance with vm_state active and task_state deleting.
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-deleted-4188ed56-cc18-4a6e-982d-7829f4bdcc6c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:09 user nova-compute[75235]: INFO nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Neutron deleted interface 4188ed56-cc18-4a6e-982d-7829f4bdcc6c; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.network.neutron [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [{"id": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "address": "fa:16:3e:7c:0e:65", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e624b2a-3e", "ovs_interfaceid": "6e624b2a-3e38-49ff-815c-5d3dabb050b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0dcb6032-2d17-488b-90d0-410caec37df5", "address": "fa:16:3e:47:7d:5b", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcb6032-2d", "ovs_interfaceid": "0dcb6032-2d17-488b-90d0-410caec37df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d466bfe-13b0-41fe-ba7e-34231525e916", "address": "fa:16:3e:4b:44:c1", "network": {"id": "64ad11f7-1efd-4084-89f9-ad094d0e3275", "bridge": "br-int", "label": "tempest-device-tagging-net1-982550790", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1626d60defd14c4fbdd1b3cb95f91dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d466bfe-13", "ovs_interfaceid": "5d466bfe-13b0-41fe-ba7e-34231525e916", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Detach interface failed, port_id=4188ed56-cc18-4a6e-982d-7829f4bdcc6c, reason: Instance 6a281fe7-91eb-413d-bbbf-eefe229195a8 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing instance network info cache due to event network-changed-62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] Acquiring lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:05:09 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Creating image(s)
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'trusted_certs' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] Acquired lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.network.neutron [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Refreshing network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:09 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Took 10.06 seconds to deallocate network for instance.
Nov 29 19:05:09 user nova-compute[75235]: DEBUG nova.objects.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<eafeb96d-7762-4d67-b3ff-e1221296ecb5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "3c9d77524699cc3b822e0c192bd4d0bf8cdb900c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "3c9d77524699cc3b822e0c192bd4d0bf8cdb900c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "82ad7dbdf54d1f9dcb60c1006953c157d5f45e08" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.278s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "82ad7dbdf54d1f9dcb60c1006953c157d5f45e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "82ad7dbdf54d1f9dcb60c1006953c157d5f45e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08 --force-share --output=json" returned: 0 in 1.298s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08,backing_fmt=raw /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-dfe48fba-bfeb-40d0-a1ea-723efc161850 req-d4fc8658-2d17-4ac7-b82a-adebc32b322f service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dfe48fba-bfeb-40d0-a1ea-723efc161850 req-d4fc8658-2d17-4ac7-b82a-adebc32b322f service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dfe48fba-bfeb-40d0-a1ea-723efc161850 req-d4fc8658-2d17-4ac7-b82a-adebc32b322f service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dfe48fba-bfeb-40d0-a1ea-723efc161850 req-d4fc8658-2d17-4ac7-b82a-adebc32b322f service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-dfe48fba-bfeb-40d0-a1ea-723efc161850 req-d4fc8658-2d17-4ac7-b82a-adebc32b322f service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:11 user nova-compute[75235]: WARNING nova.compute.manager [req-dfe48fba-bfeb-40d0-a1ea-723efc161850 req-d4fc8658-2d17-4ac7-b82a-adebc32b322f service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state active and task_state rescuing.
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08,backing_fmt=raw /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue" returned: 0 in 0.135s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "82ad7dbdf54d1f9dcb60c1006953c157d5f45e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 1.441s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'migration_context' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Object Instance<9e3e385e-b3ea-4dae-923c-eddacb2a42d7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Start _get_guest_xml network_info=[{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "vif_mac": "fa:16:3e:fe:ec:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7878e26e-c9b4-4aaa-8a27-1526a062683f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '0477a356-d176-49b6-a703-6f6a9b961f46', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYmwSJBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9e3e385e-b3ea-4dae-923c-eddacb2a42d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c768b3db-abf8-4ab8-b2d4-06a521245d65', 'serial': 'c768b3db-abf8-4ab8-b2d4-06a521245d65'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'resources' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.part --force-share --output=json" returned: 0 in 0.286s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.images [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] 2a06338f-b0a3-480e-9e2e-49202a315c43 was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.part /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Object Instance<9e3e385e-b3ea-4dae-923c-eddacb2a42d7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Object Instance<9e3e385e-b3ea-4dae-923c-eddacb2a42d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.objects.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Object Instance<9e3e385e-b3ea-4dae-923c-eddacb2a42d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYmwSJBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:11 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:11 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:11 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updated VIF entry in instance network info cache for port 62fcb2af-3273-4fdc-b68a-6c0492925844. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f069a1b5-e74b-451e-8d8c-401a69cff1e1 req-bfba79f5-9e57-451e-aead-d2f9ea599bbd service nova] Releasing lock "refresh_cache-eafeb96d-7762-4d67-b3ff-e1221296ecb5" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260" returned: 0 in 0.159s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1a153-59e1-4b76-a6d5-8616e61a754f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nYmwSJBC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 19:05:12 user nova-compute[75235]: node.name = iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:05:12 user nova-compute[75235]: node.tpgt = -1
Nov 29 19:05:12 user nova-compute[75235]: node.startup = automatic
Nov 29 19:05:12 user nova-compute[75235]: node.leading_login = No
Nov 29 19:05:12 user nova-compute[75235]: iface.iscsi_ifacename = default
Nov 29 19:05:12 user nova-compute[75235]: iface.net_ifacename = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.ipaddress = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.prefix_len = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.hwaddress = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.transport_name = tcp
Nov 29 19:05:12 user nova-compute[75235]: iface.initiatorname = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.vlan_id = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.vlan_priority = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.vlan_state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.iface_num = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.mtu = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.port = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.bootproto = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.subnet_mask = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.gateway = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_alt_client_id = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_dns = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_learn_iqn = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_vendor_id_state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_vendor_id = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.dhcp_slp_da = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.fragmentation = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.gratuitous_arp = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.incoming_forwarding = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.tos_state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.tos = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.ttl = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.delayed_ack = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.tcp_nagle = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.tcp_wsf_state = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.tcp_wsf = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.tcp_timer_scale = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.tcp_timestamp = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.redirect = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.def_task_mgmt_timeout = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.header_digest = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.data_digest = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.immediate_data = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.initial_r2t = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.data_seq_inorder = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.data_pdu_inorder = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.erl = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.max_receive_data_len = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.first_burst_len = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.max_outstanding_r2t = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.max_burst_len = 0
Nov 29 19:05:12 user nova-compute[75235]: iface.chap_auth = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.bidi_chap = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.strict_login_compliance = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.discovery_auth = <empty>
Nov 29 19:05:12 user nova-compute[75235]: iface.discovery_logout = <empty>
Nov 29 19:05:12 user nova-compute[75235]: node.discovery_address = <empty>
Nov 29 19:05:12 user nova-compute[75235]: node.discovery_port = 0
Nov 29 19:05:12 user nova-compute[75235]: node.discovery_type = static
Nov 29 19:05:12 user nova-compute[75235]: node.session.initial_cmdsn = 0
Nov 29 19:05:12 user nova-compute[75235]: node.session.initial_login_retry_max = 8
Nov 29 19:05:12 user nova-compute[75235]: node.session.xmit_thread_priority = -20
Nov 29 19:05:12 user nova-compute[75235]: node.session.cmds_max = 128
Nov 29 19:05:12 user nova-compute[75235]: node.session.queue_depth = 32
Nov 29 19:05:12 user nova-compute[75235]: node.session.nr_sessions = 1
Nov 29 19:05:12 user nova-compute[75235]: node.session.auth.authmethod = CHAP
Nov 29 19:05:12 user nova-compute[75235]: node.session.auth.username = nYmwSJBC
Nov 29 19:05:12 user nova-compute[75235]: node.session.auth.password = ***
Nov 29 19:05:12 user nova-compute[75235]: node.session.auth.username_in = <empty>
Nov 29 19:05:12 user nova-compute[75235]: node.session.auth.password_in = <empty>
Nov 29 19:05:12 user nova-compute[75235]: node.session.auth.chap_algs = MD5
Nov 29 19:05:12 user nova-compute[75235]: node.session.timeo.replacement_timeout = 120
Nov 29 19:05:12 user nova-compute[75235]: node.session.err_timeo.abort_timeout = 15
Nov 29 19:05:12 user nova-compute[75235]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 19:05:12 user nova-compute[75235]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 19:05:12 user nova-compute[75235]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.FastAbort = Yes
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.InitialR2T = No
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.ImmediateData = Yes
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.MaxConnections = 1
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 19:05:12 user nova-compute[75235]: node.session.iscsi.ERL = 0
Nov 29 19:05:12 user nova-compute[75235]: node.session.scan = manual
Nov 29 19:05:12 user nova-compute[75235]: node.session.reopen_max = 0
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].address = 172.16.0.220
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].port = 3260
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].startup = manual
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].tcp.window_size = 524288
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].tcp.type_of_service = 0
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].timeo.logout_timeout = 15
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].timeo.login_timeout = 15
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].timeo.auth_timeout = 45
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].iscsi.DataDigest = None
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].iscsi.IFMarker = No
Nov 29 19:05:12 user nova-compute[75235]: node.conn[0].iscsi.OFMarker = No
Nov 29 19:05:12 user nova-compute[75235]: # END RECORD
Nov 29 19:05:12 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-7d1e5368-d36a-486e-8330-9fd32a1e96ea req-e1441a73-d66f-4441-b353-b39b9db3b990 service nova] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Received event network-vif-deleted-5d466bfe-13b0-41fe-ba7e-34231525e916 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c331c1-0b21-4509-abe3-9c0d9b97635c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.118s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2accc02c-0a81-4b44-a453-2529c46c4520]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYmwSJBC {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nYmwSJBC" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c71c2c-a4ad-4c82-9d97-b8068f519c7e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nYmwSJBC'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ea372-9fb3-4475-bd14-5e15dcdd3bac]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba8a8a4-4bef-4687-939d-ac6426eb5a5d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:12 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:12 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caed9a1-70af-4b22-bcbc-077e92cfdf1c]: (4, ('0 0 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYmwSJBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.516s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] <== connect_volume: return (518ms) {'type': 'block', 'scsi_wwn': '23631616630646164', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631616630646164', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.part /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.converted" returned: 0 in 0.815s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-fa77c7fe-18e5-4112-ad28-73ea8f7ba9e3 req-2bde55ae-2998-4b33-af6e-ee9135ea43d2 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-deleted-78180abc-79e1-4b4f-bd98-3d77701f3863 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:12 user nova-compute[75235]: INFO nova.compute.manager [req-fa77c7fe-18e5-4112-ad28-73ea8f7ba9e3 req-2bde55ae-2998-4b33-af6e-ee9135ea43d2 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Neutron deleted interface 78180abc-79e1-4b4f-bd98-3d77701f3863; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.network.neutron [req-fa77c7fe-18e5-4112-ad28-73ea8f7ba9e3 req-2bde55ae-2998-4b33-af6e-ee9135ea43d2 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "address": "fa:16:3e:66:1d:e8", "network": {"id": "8b118dd7-79ac-4ffc-b9d3-6f4bfa21c939", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1056730313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86cc49ca-67", "ovs_interfaceid": "86cc49ca-6749-42d2-baf3-d5612b552fb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-fa77c7fe-18e5-4112-ad28-73ea8f7ba9e3 req-2bde55ae-2998-4b33-af6e-ee9135ea43d2 service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Detach interface failed, port_id=78180abc-79e1-4b4f-bd98-3d77701f3863, reason: Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-710912652',display_name='tempest-ServerStableDeviceRescueTest-server-710912652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-710912652',id=4,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEE4xxI+rQAyw/TzS9A4k6eJoe1wHbvSnlCb5Nulp5mkRRugqtYAQDnxmY/dTLGRZaveb1cl3jcqZZS93b/kPlX06OJHF035hxQSxdyQNHDmeTHLtUvPxUQmDXyo+SK9A==',key_name='tempest-keypair-2119009507',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff5711373c84c64ae6e6b37a2b6e6e7',ramdisk_id='',reservation_id='r-0mqvpcox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2102571705',owner_user_name='tempest-ServerStableDeviceRescueTest-2102571705-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a8c2e833baa4dd9b5e747cb9b80d0d8',uuid=9e3e385e-b3ea-4dae-923c-eddacb2a42d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "vif_mac": "fa:16:3e:fe:ec:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converting VIF {"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "vif_mac": "fa:16:3e:fe:ec:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.objects.base [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Object Instance<9e3e385e-b3ea-4dae-923c-eddacb2a42d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:05:12 user nova-compute[75235]:   <uuid>9e3e385e-b3ea-4dae-923c-eddacb2a42d7</uuid>
Nov 29 19:05:12 user nova-compute[75235]:   <name>instance-00000004</name>
Nov 29 19:05:12 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:05:12 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:05:12 user nova-compute[75235]:   <metadata>
Nov 29 19:05:12 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:05:12 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:05:12 user nova-compute[75235]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-710912652</nova:name>
Nov 29 19:05:12 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:05:11</nova:creationTime>
Nov 29 19:05:12 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:05:12 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:05:12 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:05:12 user nova-compute[75235]:       <nova:owner>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:user uuid="3a8c2e833baa4dd9b5e747cb9b80d0d8">tempest-ServerStableDeviceRescueTest-2102571705-project-member</nova:user>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:project uuid="2ff5711373c84c64ae6e6b37a2b6e6e7">tempest-ServerStableDeviceRescueTest-2102571705</nova:project>
Nov 29 19:05:12 user nova-compute[75235]:       </nova:owner>
Nov 29 19:05:12 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:05:12 user nova-compute[75235]:       <nova:ports>
Nov 29 19:05:12 user nova-compute[75235]:         <nova:port uuid="e3569ef3-c352-424a-8e4a-2be65c7de3a5">
Nov 29 19:05:12 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:05:12 user nova-compute[75235]:         </nova:port>
Nov 29 19:05:12 user nova-compute[75235]:       </nova:ports>
Nov 29 19:05:12 user nova-compute[75235]:     </nova:instance>
Nov 29 19:05:12 user nova-compute[75235]:   </metadata>
Nov 29 19:05:12 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:05:12 user nova-compute[75235]:     <system>
Nov 29 19:05:12 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:05:12 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:05:12 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:05:12 user nova-compute[75235]:       <entry name="serial">9e3e385e-b3ea-4dae-923c-eddacb2a42d7</entry>
Nov 29 19:05:12 user nova-compute[75235]:       <entry name="uuid">9e3e385e-b3ea-4dae-923c-eddacb2a42d7</entry>
Nov 29 19:05:12 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:05:12 user nova-compute[75235]:     </system>
Nov 29 19:05:12 user nova-compute[75235]:   </sysinfo>
Nov 29 19:05:12 user nova-compute[75235]:   <os>
Nov 29 19:05:12 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:05:12 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:05:12 user nova-compute[75235]:   </os>
Nov 29 19:05:12 user nova-compute[75235]:   <features>
Nov 29 19:05:12 user nova-compute[75235]:     <acpi/>
Nov 29 19:05:12 user nova-compute[75235]:     <apic/>
Nov 29 19:05:12 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:05:12 user nova-compute[75235]:   </features>
Nov 29 19:05:12 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:05:12 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:05:12 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:05:12 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:05:12 user nova-compute[75235]:   </clock>
Nov 29 19:05:12 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:05:12 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:05:12 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:05:12 user nova-compute[75235]:   </cpu>
Nov 29 19:05:12 user nova-compute[75235]:   <devices>
Nov 29 19:05:12 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:05:12 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:05:12 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk"/>
Nov 29 19:05:12 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:05:12 user nova-compute[75235]:     </disk>
Nov 29 19:05:12 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:05:12 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:05:12 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:05:12 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:05:12 user nova-compute[75235]:       <serial>c768b3db-abf8-4ab8-b2d4-06a521245d65</serial>
Nov 29 19:05:12 user nova-compute[75235]:     </disk>
Nov 29 19:05:12 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:05:12 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:05:12 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue"/>
Nov 29 19:05:12 user nova-compute[75235]:       <target dev="vdc" bus="virtio"/>
Nov 29 19:05:12 user nova-compute[75235]:       <boot order="1"/>
Nov 29 19:05:12 user nova-compute[75235]:     </disk>
Nov 29 19:05:12 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:05:12 user nova-compute[75235]:       <mac address="fa:16:3e:fe:ec:c3"/>
Nov 29 19:05:12 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:12 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:05:12 user nova-compute[75235]:       <target dev="tape3569ef3-c3"/>
Nov 29 19:05:12 user nova-compute[75235]:     </interface>
Nov 29 19:05:12 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:05:12 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/console.log" append="off"/>
Nov 29 19:05:12 user nova-compute[75235]:     </serial>
Nov 29 19:05:12 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:05:12 user nova-compute[75235]:     <video>
Nov 29 19:05:12 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:12 user nova-compute[75235]:     </video>
Nov 29 19:05:12 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:05:12 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:05:12 user nova-compute[75235]:     </rng>
Nov 29 19:05:12 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:05:12 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:05:12 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:05:12 user nova-compute[75235]:     </memballoon>
Nov 29 19:05:12 user nova-compute[75235]:   </devices>
Nov 29 19:05:12 user nova-compute[75235]: </domain>
Nov 29 19:05:12 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:05:12 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance destroyed successfully.
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "3c9d77524699cc3b822e0c192bd4d0bf8cdb900c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.713s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] No VIF found with MAC fa:16:3e:fe:ec:c3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c --force-share --output=json" returned: 0 in 0.221s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "3c9d77524699cc3b822e0c192bd4d0bf8cdb900c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "3c9d77524699cc3b822e0c192bd4d0bf8cdb900c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c --force-share --output=json" returned: 0 in 0.244s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c,backing_fmt=raw /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c,backing_fmt=raw /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk 1073741824" returned: 0 in 0.068s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "3c9d77524699cc3b822e0c192bd4d0bf8cdb900c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:13 user nova-compute[75235]: INFO nova.compute.manager [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] [instance: 6a281fe7-91eb-413d-bbbf-eefe229195a8] Took 3.48 seconds to detach 3 volumes for instance.
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c --force-share --output=json" returned: 0 in 0.248s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG nova.objects.instance [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'migration_context' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG nova.objects.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<eafeb96d-7762-4d67-b3ff-e1221296ecb5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Rebasing disk image.
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 -F raw /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:13 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:14 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Deleted allocations for instance 6a281fe7-91eb-413d-bbbf-eefe229195a8
Nov 29 19:05:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2bc97a44-8373-40fd-9f2b-6a97c5e1069d tempest-TaggedBootDevicesTest-397264967 tempest-TaggedBootDevicesTest-397264967-project-member] Lock "6a281fe7-91eb-413d-bbbf-eefe229195a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.440s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-deleted-86cc49ca-6749-42d2-baf3-d5612b552fb3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:14 user nova-compute[75235]: INFO nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Neutron deleted interface 86cc49ca-6749-42d2-baf3-d5612b552fb3; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d300876-7a9b-4756-b1a3-40118556fd87", "address": "fa:16:3e:d4:c2:1b", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d300876-7a", "ovs_interfaceid": "9d300876-7a9b-4756-b1a3-40118556fd87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Detach interface failed, port_id=86cc49ca-6749-42d2-baf3-d5612b552fb3, reason: Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-deleted-9d300876-7a9b-4756-b1a3-40118556fd87 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:14 user nova-compute[75235]: INFO nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Neutron deleted interface 9d300876-7a9b-4756-b1a3-40118556fd87; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a2ed01a1-0a46-453c-b542-37979837174f", "address": "fa:16:3e:27:de:c3", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ed01a1-0a", "ovs_interfaceid": "a2ed01a1-0a46-453c-b542-37979837174f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Detach interface failed, port_id=9d300876-7a9b-4756-b1a3-40118556fd87, reason: Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-deleted-a2ed01a1-0a46-453c-b542-37979837174f {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:14 user nova-compute[75235]: INFO nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Neutron deleted interface a2ed01a1-0a46-453c-b542-37979837174f; detaching it from the instance and deleting it from the info cache
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [{"id": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "address": "fa:16:3e:4e:4f:e7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2180ed4f-ef", "ovs_interfaceid": "2180ed4f-ef9b-478b-98d4-fc1191c8132f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "address": "fa:16:3e:1e:f7:f7", "network": {"id": "a117d47d-c4b1-420e-9577-672c0a3acb44", "bridge": "br-int", "label": "tempest-device-tagging-net1-1208433507", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa21488c6-77", "ovs_interfaceid": "a21488c6-77a7-46f8-a4e1-4bafd95c87ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "address": "fa:16:3e:8c:3c:d9", "network": {"id": "10d1c3bc-b054-486d-aa42-0328f693c4b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935867084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7b927f53f71b4768b4411cc6b9c46640", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8b3ee-5a", "ovs_interfaceid": "8bb8b3ee-5a58-480c-b03c-87858cc2483a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-95ae825c-7bfe-4bbf-81d6-49e3a236bbf7 req-eded9b7b-a558-4beb-861a-398b34ad7849 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95ae825c-7bfe-4bbf-81d6-49e3a236bbf7 req-eded9b7b-a558-4beb-861a-398b34ad7849 service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95ae825c-7bfe-4bbf-81d6-49e3a236bbf7 req-eded9b7b-a558-4beb-861a-398b34ad7849 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95ae825c-7bfe-4bbf-81d6-49e3a236bbf7 req-eded9b7b-a558-4beb-861a-398b34ad7849 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-95ae825c-7bfe-4bbf-81d6-49e3a236bbf7 req-eded9b7b-a558-4beb-861a-398b34ad7849 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:14 user nova-compute[75235]: WARNING nova.compute.manager [req-95ae825c-7bfe-4bbf-81d6-49e3a236bbf7 req-eded9b7b-a558-4beb-861a-398b34ad7849 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state active and task_state rescuing.
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8297ffc4-5d33-44c6-98b3-847eeb3ff06d req-f9806c75-ba70-427b-89ee-1ef8fbd6116d service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Detach interface failed, port_id=a2ed01a1-0a46-453c-b542-37979837174f, reason: Instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:05:14 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Took 7.36 seconds to deallocate network for instance.
Nov 29 19:05:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:05:15 user nova-compute[75235]: INFO nova.compute.claims [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Claim successful on node user
Nov 29 19:05:15 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:05:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.policy [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3da1a3f4fe44a6b8d177891669e67bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb3eff325cd4b08bb2b3a3a1545433f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-f6b68ea1-5057-412f-86ed-5eca00db80bf req-0d675ae2-f79e-442c-b7cf-1b09bab3d99c service nova] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Received event network-vif-deleted-8bb8b3ee-5a58-480c-b03c-87858cc2483a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-15b05a46-0bb1-4247-bf23-fa0f1ecf6d43 req-c853b9b4-b634-42c4-801e-1595b6ccc8d8 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-15b05a46-0bb1-4247-bf23-fa0f1ecf6d43 req-c853b9b4-b634-42c4-801e-1595b6ccc8d8 service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-15b05a46-0bb1-4247-bf23-fa0f1ecf6d43 req-c853b9b4-b634-42c4-801e-1595b6ccc8d8 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-15b05a46-0bb1-4247-bf23-fa0f1ecf6d43 req-c853b9b4-b634-42c4-801e-1595b6ccc8d8 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-15b05a46-0bb1-4247-bf23-fa0f1ecf6d43 req-c853b9b4-b634-42c4-801e-1595b6ccc8d8 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:16 user nova-compute[75235]: WARNING nova.compute.manager [req-15b05a46-0bb1-4247-bf23-fa0f1ecf6d43 req-c853b9b4-b634-42c4-801e-1595b6ccc8d8 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state active and task_state rescuing.
Nov 29 19:05:16 user nova-compute[75235]: INFO nova.virt.block_device [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Booting with volume 5c384bd6-f224-4711-aa47-ee9a16ca9bff at /dev/vda
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 -F raw /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk" returned: 0 in 3.219s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Ensure instance console log exists: /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Start _get_guest_xml network_info=[{"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d65db8f8d814b0104acf52dc79164511',container_format='bare',created_at=2023-11-29T19:03:02Z,direct_url=<?>,disk_format='qcow2',id=2a06338f-b0a3-480e-9e2e-49202a315c43,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1165392797-shelved',owner='f049b77ff5714114a8808a39c57e1a94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T19:03:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'bbd2092a-b57e-4ab9-9234-6e73ca9b9c2a', 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtlJhVUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'eafeb96d-7762-4d67-b3ff-e1221296ecb5', 'attached_at': '', 'detached_at': '', 'volume_id': '2c6b30c1-aadb-444b-b17e-1c01b3e269a3', 'serial': '2c6b30c1-aadb-444b-b17e-1c01b3e269a3'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG os_brick.utils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d65db8f8d814b0104acf52dc79164511',container_format='bare',created_at=2023-11-29T19:03:02Z,direct_url=<?>,disk_format='qcow2',id=2a06338f-b0a3-480e-9e2e-49202a315c43,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1165392797-shelved',owner='f049b77ff5714114a8808a39c57e1a94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T19:03:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'vcpu_model' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b306d-1c3b-40f7-b47d-e995c20df54c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.objects.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<eafeb96d-7762-4d67-b3ff-e1221296ecb5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtlJhVUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:16 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:16 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:16 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a9b338-6113-4455-9244-1fbb0c930217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c63e7b3-ab27-4c6c-8bd4-9a49d0ad110c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc3f099-b370-4375-aeb0-912934090ec2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:05:17 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e99e53-103c-4544-99e1-b6c41b1c652b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec578f0d-f4b9-45b5-9e66-300e6bc0f43a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3] added
Nov 29 19:05:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:05:17 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a9dca-e5c9-49c1-92ff-cd9d5d3f7893]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.utils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating existing volume attachment record: 3ec76f9b-d863-4fdd-83ab-203c10f607b0 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a60611a-d593-4032-b60f-f36c6893f0b6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[387f2fd9-2c73-47e3-8a34-3d9e3c29b1be]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtlJhVUv {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtlJhVUv" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86c591-c435-421e-a634-7b77a7111ac3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jtlJhVUv'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[66270b19-c142-4d04-8bac-9bed12b0eb2c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03296f4-bc99-4bc5-8bb7-a48d821adb78]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2a437e-c96b-4e6e-98b4-e75ae484cb35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260]
Nov 29 19:05:17 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260] successful.
Nov 29 19:05:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7555be-366d-4a55-b726-fe3b419fcc05]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[92223713-9d3c-45c9-89f9-5d7359fae895]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:17 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:05:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:17 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:05:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG nova.network.neutron [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Successfully created port: bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2749bbf1-31cd-475b-865f-0387d2e2b249]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtlJhVUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:05:17 user nova-compute[75235]: INFO nova.compute.manager [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] [instance: 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c] Took 3.05 seconds to detach 3 volumes for instance.
Nov 29 19:05:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a0ff953b-d581-4bb1-b175-3d66f9a1aba3 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '26237393565353865', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237393565353865', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1165392797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1165392797',id=3,image_ref='2a06338f-b0a3-480e-9e2e-49202a315c43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1094556375',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-e0vwlvoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member',shelved_at='2023-11-29T19:03:07.814020',shelved_host='user',shelved_image_id='2a06338f-b0a3-480e-9e2e-49202a315c43'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=eafeb96d-7762-4d67-b3ff-e1221296ecb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.objects.instance [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'pci_devices' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Successfully updated port: bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.objects.base [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<eafeb96d-7762-4d67-b3ff-e1221296ecb5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:05:18 user nova-compute[75235]:   <uuid>eafeb96d-7762-4d67-b3ff-e1221296ecb5</uuid>
Nov 29 19:05:18 user nova-compute[75235]:   <name>instance-00000003</name>
Nov 29 19:05:18 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:05:18 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:05:18 user nova-compute[75235]:   <metadata>
Nov 29 19:05:18 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:05:18 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:05:18 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1165392797</nova:name>
Nov 29 19:05:18 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:05:16</nova:creationTime>
Nov 29 19:05:18 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:05:18 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:05:18 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:05:18 user nova-compute[75235]:       <nova:owner>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:user uuid="556161926cf5420b82b6f33221ac8fb4">tempest-AttachVolumeShelveTestJSON-850280898-project-member</nova:user>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:project uuid="f049b77ff5714114a8808a39c57e1a94">tempest-AttachVolumeShelveTestJSON-850280898</nova:project>
Nov 29 19:05:18 user nova-compute[75235]:       </nova:owner>
Nov 29 19:05:18 user nova-compute[75235]:       <nova:root type="image" uuid="2a06338f-b0a3-480e-9e2e-49202a315c43"/>
Nov 29 19:05:18 user nova-compute[75235]:       <nova:ports>
Nov 29 19:05:18 user nova-compute[75235]:         <nova:port uuid="62fcb2af-3273-4fdc-b68a-6c0492925844">
Nov 29 19:05:18 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 19:05:18 user nova-compute[75235]:         </nova:port>
Nov 29 19:05:18 user nova-compute[75235]:       </nova:ports>
Nov 29 19:05:18 user nova-compute[75235]:     </nova:instance>
Nov 29 19:05:18 user nova-compute[75235]:   </metadata>
Nov 29 19:05:18 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:05:18 user nova-compute[75235]:     <system>
Nov 29 19:05:18 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:05:18 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:05:18 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:05:18 user nova-compute[75235]:       <entry name="serial">eafeb96d-7762-4d67-b3ff-e1221296ecb5</entry>
Nov 29 19:05:18 user nova-compute[75235]:       <entry name="uuid">eafeb96d-7762-4d67-b3ff-e1221296ecb5</entry>
Nov 29 19:05:18 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:05:18 user nova-compute[75235]:     </system>
Nov 29 19:05:18 user nova-compute[75235]:   </sysinfo>
Nov 29 19:05:18 user nova-compute[75235]:   <os>
Nov 29 19:05:18 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:05:18 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:05:18 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:05:18 user nova-compute[75235]:   </os>
Nov 29 19:05:18 user nova-compute[75235]:   <features>
Nov 29 19:05:18 user nova-compute[75235]:     <acpi/>
Nov 29 19:05:18 user nova-compute[75235]:     <apic/>
Nov 29 19:05:18 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:05:18 user nova-compute[75235]:   </features>
Nov 29 19:05:18 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:05:18 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:05:18 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:05:18 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:05:18 user nova-compute[75235]:   </clock>
Nov 29 19:05:18 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:05:18 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:05:18 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:05:18 user nova-compute[75235]:   </cpu>
Nov 29 19:05:18 user nova-compute[75235]:   <devices>
Nov 29 19:05:18 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:05:18 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:05:18 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk"/>
Nov 29 19:05:18 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:05:18 user nova-compute[75235]:     </disk>
Nov 29 19:05:18 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:05:18 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:05:18 user nova-compute[75235]:       <source dev="/dev/sdc"/>
Nov 29 19:05:18 user nova-compute[75235]:       <target dev="vdc" bus="virtio"/>
Nov 29 19:05:18 user nova-compute[75235]:       <serial>2c6b30c1-aadb-444b-b17e-1c01b3e269a3</serial>
Nov 29 19:05:18 user nova-compute[75235]:     </disk>
Nov 29 19:05:18 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:05:18 user nova-compute[75235]:       <mac address="fa:16:3e:1f:30:a0"/>
Nov 29 19:05:18 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:18 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:05:18 user nova-compute[75235]:       <target dev="tap62fcb2af-32"/>
Nov 29 19:05:18 user nova-compute[75235]:     </interface>
Nov 29 19:05:18 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:05:18 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/console.log" append="off"/>
Nov 29 19:05:18 user nova-compute[75235]:     </serial>
Nov 29 19:05:18 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:05:18 user nova-compute[75235]:     <video>
Nov 29 19:05:18 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:18 user nova-compute[75235]:     </video>
Nov 29 19:05:18 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:05:18 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:05:18 user nova-compute[75235]:     </rng>
Nov 29 19:05:18 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:05:18 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:05:18 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:05:18 user nova-compute[75235]:     </memballoon>
Nov 29 19:05:18 user nova-compute[75235]:   </devices>
Nov 29 19:05:18 user nova-compute[75235]: </domain>
Nov 29 19:05:18 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1165392797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1165392797',id=3,image_ref='2a06338f-b0a3-480e-9e2e-49202a315c43',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1094556375',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-e0vwlvoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member',shelved_at='2023-11-29T19:03:07.814020',shelved_host='user',shelved_image_id='2a06338f-b0a3-480e-9e2e-49202a315c43'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=eafeb96d-7762-4d67-b3ff-e1221296ecb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG os_vif [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '356730ff-14cd-5570-bcaa-14ee17a3cbc6', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Deleted allocations for instance 31eaaa64-f6cb-4e8a-bf81-d349cf72c34c
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62fcb2af-32, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62fcb2af-32, col_values=(('qos', UUID('d649d00b-8ccd-42ba-9e68-4adecce71654')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62fcb2af-32, col_values=(('external_ids', {'iface-id': '62fcb2af-3273-4fdc-b68a-6c0492925844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:30:a0', 'vm-uuid': 'eafeb96d-7762-4d67-b3ff-e1221296ecb5'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: INFO os_vif [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32')
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-031a6618-f48c-46ef-aaef-c19b388f9751 tempest-TaggedBootDevicesTest_v242-1070290409 tempest-TaggedBootDevicesTest_v242-1070290409-project-member] Lock "31eaaa64-f6cb-4e8a-bf81-d349cf72c34c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.524s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No VIF found with MAC fa:16:3e:1f:30:a0, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing instance network info cache due to event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:18 user nova-compute[75235]: DEBUG nova.network.neutron [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance network_info: |[{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updated VIF entry in instance network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-64626d75-d492-4365-94dd-fdffcdacc52a req-93a1f1f2-69f9-4e99-8b5a-ed28210b578c service nova] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-ea1b8da0-f7c6-4dc6-9eac-11404c1331bf req-c4ada608-6b34-4d5b-bcf2-bb3c689f7974 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ea1b8da0-f7c6-4dc6-9eac-11404c1331bf req-c4ada608-6b34-4d5b-bcf2-bb3c689f7974 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ea1b8da0-f7c6-4dc6-9eac-11404c1331bf req-c4ada608-6b34-4d5b-bcf2-bb3c689f7974 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ea1b8da0-f7c6-4dc6-9eac-11404c1331bf req-c4ada608-6b34-4d5b-bcf2-bb3c689f7974 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-ea1b8da0-f7c6-4dc6-9eac-11404c1331bf req-c4ada608-6b34-4d5b-bcf2-bb3c689f7974 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:20 user nova-compute[75235]: WARNING nova.compute.manager [req-ea1b8da0-f7c6-4dc6-9eac-11404c1331bf req-c4ada608-6b34-4d5b-bcf2-bb3c689f7974 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 19:05:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-a0c50879-45e3-4c2b-ba84-9af31a7a8425 req-d76f598d-c228-443d-829b-831b3e2ff926 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a0c50879-45e3-4c2b-ba84-9af31a7a8425 req-d76f598d-c228-443d-829b-831b3e2ff926 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a0c50879-45e3-4c2b-ba84-9af31a7a8425 req-d76f598d-c228-443d-829b-831b3e2ff926 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a0c50879-45e3-4c2b-ba84-9af31a7a8425 req-d76f598d-c228-443d-829b-831b3e2ff926 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-a0c50879-45e3-4c2b-ba84-9af31a7a8425 req-d76f598d-c228-443d-829b-831b3e2ff926 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:22 user nova-compute[75235]: WARNING nova.compute.manager [req-a0c50879-45e3-4c2b-ba84-9af31a7a8425 req-d76f598d-c228-443d-829b-831b3e2ff926 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 19:05:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:05:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:05:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance spawned successfully.
Nov 29 19:05:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:05:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-89c97417-5430-4026-ba7c-39c50594b1d5 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.346s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:05:25 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Creating image(s)
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Ensure instance console log exists: /opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Start _get_guest_xml network_info=[{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '3ec76f9b-d863-4fdd-83ab-203c10f607b0', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03f7d056-56b5-45ba-a6e1-3449e35b9728', 'attached_at': '', 'detached_at': '', 'volume_id': '5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'serial': '5c384bd6-f224-4711-aa47-ee9a16ca9bff'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:05:25 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:25 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:05:25 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:05:26 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:26 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:05:26 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc08255-4a01-4b9e-ade4-ef4d3b880353]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:05:26 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92fcf74-8741-43ab-9bf7-3d81746400c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff] added
Nov 29 19:05:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f020705-9f41-4bbe-9325-203a9000f5ad]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f37df7-c802-44c8-ab09-90af46c78b1c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYRczWra {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYRczWra" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b30f08-327a-48b0-a747-6cc2aa713c9a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYRczWra'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e45313-d874-4dfd-9b08-7c658bc7f0db]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad64bb77-6a94-4e1f-b584-6ea2d37a7549]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2dd33a-9850-4e08-be75-2bd67a21d299]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]
Nov 29 19:05:26 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.
Nov 29 19:05:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7c020f-5d9c-4083-b327-f5a4fcc2971f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ba8a1-5a71-449b-bf88-d871c1814c3d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:05:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:05:26 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:05:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad8dc35-03e4-4be3-82f0-a4a71bf6d42b]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:05:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23037303161643931', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037303161643931', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1990269533',display_name='tempest-TestShelveInstance-server-1990269533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1990269533',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwuUAHo0jwzkFo+G9dHO4IbcAK7m9iueW3B1/f+1+oHWzOZUFmBkAbv7BvCrr8wX9PC/8xS2nCbpF9Wc2xUJnaZgsZxXOax+xZM2D/QvcuO6cO44p7ccbkoW5BOcb1egA==',key_name='tempest-TestShelveInstance-1055985921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb3eff325cd4b08bb2b3a3a1545433f',ramdisk_id='',reservation_id='r-s0b0nq41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1781237838',owner_user_name='tempest-TestShelveInstance-1781237838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:05:17Z,user_data=None,user_id='d3da1a3f4fe44a6b8d177891669e67bc',uuid=03f7d056-56b5-45ba-a6e1-3449e35b9728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converting VIF {"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:05:27 user nova-compute[75235]:   <uuid>03f7d056-56b5-45ba-a6e1-3449e35b9728</uuid>
Nov 29 19:05:27 user nova-compute[75235]:   <name>instance-00000010</name>
Nov 29 19:05:27 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:05:27 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:05:27 user nova-compute[75235]:   <metadata>
Nov 29 19:05:27 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:05:27 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:05:27 user nova-compute[75235]:       <nova:name>tempest-TestShelveInstance-server-1990269533</nova:name>
Nov 29 19:05:27 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:05:25</nova:creationTime>
Nov 29 19:05:27 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:05:27 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:05:27 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:05:27 user nova-compute[75235]:       <nova:owner>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:user uuid="d3da1a3f4fe44a6b8d177891669e67bc">tempest-TestShelveInstance-1781237838-project-member</nova:user>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:project uuid="bbb3eff325cd4b08bb2b3a3a1545433f">tempest-TestShelveInstance-1781237838</nova:project>
Nov 29 19:05:27 user nova-compute[75235]:       </nova:owner>
Nov 29 19:05:27 user nova-compute[75235]:       <nova:ports>
Nov 29 19:05:27 user nova-compute[75235]:         <nova:port uuid="bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc">
Nov 29 19:05:27 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 19:05:27 user nova-compute[75235]:         </nova:port>
Nov 29 19:05:27 user nova-compute[75235]:       </nova:ports>
Nov 29 19:05:27 user nova-compute[75235]:     </nova:instance>
Nov 29 19:05:27 user nova-compute[75235]:   </metadata>
Nov 29 19:05:27 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:05:27 user nova-compute[75235]:     <system>
Nov 29 19:05:27 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:05:27 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:05:27 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:05:27 user nova-compute[75235]:       <entry name="serial">03f7d056-56b5-45ba-a6e1-3449e35b9728</entry>
Nov 29 19:05:27 user nova-compute[75235]:       <entry name="uuid">03f7d056-56b5-45ba-a6e1-3449e35b9728</entry>
Nov 29 19:05:27 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:05:27 user nova-compute[75235]:     </system>
Nov 29 19:05:27 user nova-compute[75235]:   </sysinfo>
Nov 29 19:05:27 user nova-compute[75235]:   <os>
Nov 29 19:05:27 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:05:27 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:05:27 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:05:27 user nova-compute[75235]:   </os>
Nov 29 19:05:27 user nova-compute[75235]:   <features>
Nov 29 19:05:27 user nova-compute[75235]:     <acpi/>
Nov 29 19:05:27 user nova-compute[75235]:     <apic/>
Nov 29 19:05:27 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:05:27 user nova-compute[75235]:   </features>
Nov 29 19:05:27 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:05:27 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:05:27 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:05:27 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:05:27 user nova-compute[75235]:   </clock>
Nov 29 19:05:27 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:05:27 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:05:27 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:05:27 user nova-compute[75235]:   </cpu>
Nov 29 19:05:27 user nova-compute[75235]:   <devices>
Nov 29 19:05:27 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:05:27 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:05:27 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:05:27 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:05:27 user nova-compute[75235]:       <serial>5c384bd6-f224-4711-aa47-ee9a16ca9bff</serial>
Nov 29 19:05:27 user nova-compute[75235]:     </disk>
Nov 29 19:05:27 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:05:27 user nova-compute[75235]:       <mac address="fa:16:3e:d9:76:ef"/>
Nov 29 19:05:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:27 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:05:27 user nova-compute[75235]:       <target dev="tapbbdd8a68-f5"/>
Nov 29 19:05:27 user nova-compute[75235]:     </interface>
Nov 29 19:05:27 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:05:27 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728/console.log" append="off"/>
Nov 29 19:05:27 user nova-compute[75235]:     </serial>
Nov 29 19:05:27 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:05:27 user nova-compute[75235]:     <video>
Nov 29 19:05:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:27 user nova-compute[75235]:     </video>
Nov 29 19:05:27 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:05:27 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:05:27 user nova-compute[75235]:     </rng>
Nov 29 19:05:27 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:05:27 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:05:27 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:05:27 user nova-compute[75235]:     </memballoon>
Nov 29 19:05:27 user nova-compute[75235]:   </devices>
Nov 29 19:05:27 user nova-compute[75235]: </domain>
Nov 29 19:05:27 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1990269533',display_name='tempest-TestShelveInstance-server-1990269533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1990269533',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwuUAHo0jwzkFo+G9dHO4IbcAK7m9iueW3B1/f+1+oHWzOZUFmBkAbv7BvCrr8wX9PC/8xS2nCbpF9Wc2xUJnaZgsZxXOax+xZM2D/QvcuO6cO44p7ccbkoW5BOcb1egA==',key_name='tempest-TestShelveInstance-1055985921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbb3eff325cd4b08bb2b3a3a1545433f',ramdisk_id='',reservation_id='r-s0b0nq41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1781237838',owner_user_name='tempest-TestShelveInstance-1781237838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:05:17Z,user_data=None,user_id='d3da1a3f4fe44a6b8d177891669e67bc',uuid=03f7d056-56b5-45ba-a6e1-3449e35b9728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converting VIF {"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG os_vif [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1f04526-96ab-5e43-8985-1b41448c7044', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbdd8a68-f5, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbdd8a68-f5, col_values=(('qos', UUID('cdbd7ba9-ef65-462c-b61a-a0d11ace2db1')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbdd8a68-f5, col_values=(('external_ids', {'iface-id': 'bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:76:ef', 'vm-uuid': '03f7d056-56b5-45ba-a6e1-3449e35b9728'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:27 user nova-compute[75235]: INFO os_vif [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5')
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] No VIF found with MAC fa:16:3e:d9:76:ef, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:05:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG nova.compute.manager [req-3a27198a-0f5e-4517-937e-c3a90cd2b970 req-dc834087-6196-46cb-89d9-f2e161483187 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3a27198a-0f5e-4517-937e-c3a90cd2b970 req-dc834087-6196-46cb-89d9-f2e161483187 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3a27198a-0f5e-4517-937e-c3a90cd2b970 req-dc834087-6196-46cb-89d9-f2e161483187 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3a27198a-0f5e-4517-937e-c3a90cd2b970 req-dc834087-6196-46cb-89d9-f2e161483187 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG nova.compute.manager [req-3a27198a-0f5e-4517-937e-c3a90cd2b970 req-dc834087-6196-46cb-89d9-f2e161483187 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:29 user nova-compute[75235]: WARNING nova.compute.manager [req-3a27198a-0f5e-4517-937e-c3a90cd2b970 req-dc834087-6196-46cb-89d9-f2e161483187 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state building and task_state spawning.
Nov 29 19:05:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:05:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance spawned successfully.
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-fcfc43bf-8683-4e1b-9f8d-5c4cd71ec79a req-a664ea56-b894-470e-8690-a90fe736ca1b service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fcfc43bf-8683-4e1b-9f8d-5c4cd71ec79a req-a664ea56-b894-470e-8690-a90fe736ca1b service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fcfc43bf-8683-4e1b-9f8d-5c4cd71ec79a req-a664ea56-b894-470e-8690-a90fe736ca1b service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fcfc43bf-8683-4e1b-9f8d-5c4cd71ec79a req-a664ea56-b894-470e-8690-a90fe736ca1b service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-fcfc43bf-8683-4e1b-9f8d-5c4cd71ec79a req-a664ea56-b894-470e-8690-a90fe736ca1b service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:31 user nova-compute[75235]: WARNING nova.compute.manager [req-fcfc43bf-8683-4e1b-9f8d-5c4cd71ec79a req-a664ea56-b894-470e-8690-a90fe736ca1b service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state building and task_state spawning.
Nov 29 19:05:31 user nova-compute[75235]: INFO nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 29 19:05:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:05:31 user nova-compute[75235]: INFO nova.compute.manager [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Took 16.68 seconds to build instance.
Nov 29 19:05:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-74a4c0b0-296b-4db7-9882-89a6dc51f7fc tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.813s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:05:37 user nova-compute[75235]: INFO nova.compute.claims [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Claim successful on node user
Nov 29 19:05:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:37 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:05:38 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.policy [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd7f8de6a84e448793e54933003a3e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f7748eb48204224af05f0bce1d75413', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:05:38 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Creating image(s)
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "/opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "/opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "/opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.225s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.207s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk 1073741824" returned: 0 in 0.064s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Successfully created port: 5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Cannot resize image /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Ensure instance console log exists: /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Successfully updated port: 5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquired lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-changed-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Refreshing instance network info cache due to event network-changed-5669e733-8a19-4c66-8b64-0c538a0d3674. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] Acquiring lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:39 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updating instance_info_cache with network_info: [{"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Releasing lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Instance network_info: |[{"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] Acquired lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.network.neutron [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Refreshing network info cache for port 5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Start _get_guest_xml network_info=[{"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:05:40 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:40 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1612128584',display_name='tempest-TestVolumeSwap-server-1612128584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1612128584',id=17,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8qetv5NTuGjubGWswjAuziXRdPFli0kd+7AteL9QoxMIhw74liBslFwLgHJZ3H61reEqz0aZ/j6HygCFLrpfe3vp4W+ed7vzokKE5Naqf5r5Tgqd6mnjDLFH7zwVDnEw==',key_name='tempest-keypair-123751440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f7748eb48204224af05f0bce1d75413',ramdisk_id='',reservation_id='r-wqm3p16z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-329242883',owner_user_name='tempest-TestVolumeSwap-329242883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7f8de6a84e448793e54933003a3e4c',uuid=cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Converting VIF {"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lazy-loading 'pci_devices' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:05:40 user nova-compute[75235]:   <uuid>cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8</uuid>
Nov 29 19:05:40 user nova-compute[75235]:   <name>instance-00000011</name>
Nov 29 19:05:40 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:05:40 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:05:40 user nova-compute[75235]:   <metadata>
Nov 29 19:05:40 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:05:40 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:05:40 user nova-compute[75235]:       <nova:name>tempest-TestVolumeSwap-server-1612128584</nova:name>
Nov 29 19:05:40 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:05:40</nova:creationTime>
Nov 29 19:05:40 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:05:40 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:05:40 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:05:40 user nova-compute[75235]:       <nova:owner>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:user uuid="cd7f8de6a84e448793e54933003a3e4c">tempest-TestVolumeSwap-329242883-project-member</nova:user>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:project uuid="7f7748eb48204224af05f0bce1d75413">tempest-TestVolumeSwap-329242883</nova:project>
Nov 29 19:05:40 user nova-compute[75235]:       </nova:owner>
Nov 29 19:05:40 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:05:40 user nova-compute[75235]:       <nova:ports>
Nov 29 19:05:40 user nova-compute[75235]:         <nova:port uuid="5669e733-8a19-4c66-8b64-0c538a0d3674">
Nov 29 19:05:40 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 19:05:40 user nova-compute[75235]:         </nova:port>
Nov 29 19:05:40 user nova-compute[75235]:       </nova:ports>
Nov 29 19:05:40 user nova-compute[75235]:     </nova:instance>
Nov 29 19:05:40 user nova-compute[75235]:   </metadata>
Nov 29 19:05:40 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:05:40 user nova-compute[75235]:     <system>
Nov 29 19:05:40 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:05:40 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:05:40 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:05:40 user nova-compute[75235]:       <entry name="serial">cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8</entry>
Nov 29 19:05:40 user nova-compute[75235]:       <entry name="uuid">cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8</entry>
Nov 29 19:05:40 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:05:40 user nova-compute[75235]:     </system>
Nov 29 19:05:40 user nova-compute[75235]:   </sysinfo>
Nov 29 19:05:40 user nova-compute[75235]:   <os>
Nov 29 19:05:40 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:05:40 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:05:40 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:05:40 user nova-compute[75235]:   </os>
Nov 29 19:05:40 user nova-compute[75235]:   <features>
Nov 29 19:05:40 user nova-compute[75235]:     <acpi/>
Nov 29 19:05:40 user nova-compute[75235]:     <apic/>
Nov 29 19:05:40 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:05:40 user nova-compute[75235]:   </features>
Nov 29 19:05:40 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:05:40 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:05:40 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:05:40 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:05:40 user nova-compute[75235]:   </clock>
Nov 29 19:05:40 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:05:40 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:05:40 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:05:40 user nova-compute[75235]:   </cpu>
Nov 29 19:05:40 user nova-compute[75235]:   <devices>
Nov 29 19:05:40 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:05:40 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:05:40 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk"/>
Nov 29 19:05:40 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:05:40 user nova-compute[75235]:     </disk>
Nov 29 19:05:40 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:05:40 user nova-compute[75235]:       <mac address="fa:16:3e:d7:4c:12"/>
Nov 29 19:05:40 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:40 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:05:40 user nova-compute[75235]:       <target dev="tap5669e733-8a"/>
Nov 29 19:05:40 user nova-compute[75235]:     </interface>
Nov 29 19:05:40 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:05:40 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/console.log" append="off"/>
Nov 29 19:05:40 user nova-compute[75235]:     </serial>
Nov 29 19:05:40 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:05:40 user nova-compute[75235]:     <video>
Nov 29 19:05:40 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:05:40 user nova-compute[75235]:     </video>
Nov 29 19:05:40 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:05:40 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:05:40 user nova-compute[75235]:     </rng>
Nov 29 19:05:40 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:05:40 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:05:40 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:05:40 user nova-compute[75235]:     </memballoon>
Nov 29 19:05:40 user nova-compute[75235]:   </devices>
Nov 29 19:05:40 user nova-compute[75235]: </domain>
Nov 29 19:05:40 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1612128584',display_name='tempest-TestVolumeSwap-server-1612128584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1612128584',id=17,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8qetv5NTuGjubGWswjAuziXRdPFli0kd+7AteL9QoxMIhw74liBslFwLgHJZ3H61reEqz0aZ/j6HygCFLrpfe3vp4W+ed7vzokKE5Naqf5r5Tgqd6mnjDLFH7zwVDnEw==',key_name='tempest-keypair-123751440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f7748eb48204224af05f0bce1d75413',ramdisk_id='',reservation_id='r-wqm3p16z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-329242883',owner_user_name='tempest-TestVolumeSwap-329242883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7f8de6a84e448793e54933003a3e4c',uuid=cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Converting VIF {"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG os_vif [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'effd8199-afd9-5083-b66e-6b024d973909', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5669e733-8a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5669e733-8a, col_values=(('qos', UUID('1c0d9465-d7ec-4143-80eb-fefc3106deae')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5669e733-8a, col_values=(('external_ids', {'iface-id': '5669e733-8a19-4c66-8b64-0c538a0d3674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:4c:12', 'vm-uuid': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:40 user nova-compute[75235]: INFO os_vif [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a')
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:05:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] No VIF found with MAC fa:16:3e:d7:4c:12, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:05:41 user nova-compute[75235]: DEBUG nova.network.neutron [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updated VIF entry in instance network info cache for port 5669e733-8a19-4c66-8b64-0c538a0d3674. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:05:41 user nova-compute[75235]: DEBUG nova.network.neutron [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updating instance_info_cache with network_info: [{"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ba5a19fd-ac7c-4863-bc35-cde23ee08fec req-f2f2ffc6-4826-4934-b52a-041f4c9dc929 service nova] Releasing lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG nova.compute.manager [req-b5cc7526-6780-4f2f-a819-61f0f876dba3 req-e1dc8ebe-152f-4bdc-aef4-57a0f1f27d96 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b5cc7526-6780-4f2f-a819-61f0f876dba3 req-e1dc8ebe-152f-4bdc-aef4-57a0f1f27d96 service nova] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b5cc7526-6780-4f2f-a819-61f0f876dba3 req-e1dc8ebe-152f-4bdc-aef4-57a0f1f27d96 service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b5cc7526-6780-4f2f-a819-61f0f876dba3 req-e1dc8ebe-152f-4bdc-aef4-57a0f1f27d96 service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG nova.compute.manager [req-b5cc7526-6780-4f2f-a819-61f0f876dba3 req-e1dc8ebe-152f-4bdc-aef4-57a0f1f27d96 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] No waiting events found dispatching network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:42 user nova-compute[75235]: WARNING nova.compute.manager [req-b5cc7526-6780-4f2f-a819-61f0f876dba3 req-e1dc8ebe-152f-4bdc-aef4-57a0f1f27d96 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received unexpected event network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 for instance with vm_state building and task_state spawning.
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-e88e7bca-8f99-47f9-993b-c96abb959fce req-4295c3c7-99ae-4006-8ed2-493d7949df22 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e88e7bca-8f99-47f9-993b-c96abb959fce req-4295c3c7-99ae-4006-8ed2-493d7949df22 service nova] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e88e7bca-8f99-47f9-993b-c96abb959fce req-4295c3c7-99ae-4006-8ed2-493d7949df22 service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e88e7bca-8f99-47f9-993b-c96abb959fce req-4295c3c7-99ae-4006-8ed2-493d7949df22 service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-e88e7bca-8f99-47f9-993b-c96abb959fce req-4295c3c7-99ae-4006-8ed2-493d7949df22 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] No waiting events found dispatching network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:05:44 user nova-compute[75235]: WARNING nova.compute.manager [req-e88e7bca-8f99-47f9-993b-c96abb959fce req-4295c3c7-99ae-4006-8ed2-493d7949df22 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received unexpected event network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 for instance with vm_state building and task_state spawning.
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:05:44 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Instance spawned successfully.
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:05:44 user nova-compute[75235]: INFO nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 29 19:05:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:05:44 user nova-compute[75235]: INFO nova.compute.manager [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Took 7.51 seconds to build instance.
Nov 29 19:05:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bb413ab7-3483-46ec-9c8f-4b9ea11b31de tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.627s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:48 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.033s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:48 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:05:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:05:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7443MB free_disk=25.374187469482422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance aa2da6c4-f2d2-4598-9113-122b3ca34133 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 05533a2c-8f8e-4bfd-8b36-92470a10d5e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 03f7d056-56b5-45ba-a6e1-3449e35b9728 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:05:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:55 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:55 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating instance_info_cache with network_info: [{"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:05:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:05:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:05:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:58 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:05:58 user nova-compute[75235]: INFO nova.compute.claims [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Claim successful on node user
Nov 29 19:05:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:05:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.policy [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c547f019112442b7ac97442ce3432365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b84f68d6c554611a982ef7326409952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:05:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Creating image(s)
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:05:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk 1073741824" returned: 0 in 0.061s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.218s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Successfully created port: 5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Cannot resize image /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Ensure instance console log exists: /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Successfully updated port: 5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-changed-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Refreshing instance network info cache due to event network-changed-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] Acquiring lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updating instance_info_cache with network_info: [{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Instance network_info: |[{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] Acquired lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Refreshing network info cache for port 5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Start _get_guest_xml network_info=[{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:06:01 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:01 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718120687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718120687',id=18,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-80iwsbb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:00Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=9d57cb98-5640-4104-ab59-fc0f4786433c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:01 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d57cb98-5640-4104-ab59-fc0f4786433c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:06:02 user nova-compute[75235]:   <uuid>9d57cb98-5640-4104-ab59-fc0f4786433c</uuid>
Nov 29 19:06:02 user nova-compute[75235]:   <name>instance-00000012</name>
Nov 29 19:06:02 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:06:02 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:06:02 user nova-compute[75235]:   <metadata>
Nov 29 19:06:02 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:06:02 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:06:02 user nova-compute[75235]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1718120687</nova:name>
Nov 29 19:06:02 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:06:01</nova:creationTime>
Nov 29 19:06:02 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:06:02 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:06:02 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:06:02 user nova-compute[75235]:       <nova:owner>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:user uuid="c547f019112442b7ac97442ce3432365">tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member</nova:user>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:project uuid="9b84f68d6c554611a982ef7326409952">tempest-ServerBootFromVolumeStableRescueTest-1553615524</nova:project>
Nov 29 19:06:02 user nova-compute[75235]:       </nova:owner>
Nov 29 19:06:02 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:06:02 user nova-compute[75235]:       <nova:ports>
Nov 29 19:06:02 user nova-compute[75235]:         <nova:port uuid="5f5671a6-9e9f-4e2b-9e46-dbd420e435d6">
Nov 29 19:06:02 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 19:06:02 user nova-compute[75235]:         </nova:port>
Nov 29 19:06:02 user nova-compute[75235]:       </nova:ports>
Nov 29 19:06:02 user nova-compute[75235]:     </nova:instance>
Nov 29 19:06:02 user nova-compute[75235]:   </metadata>
Nov 29 19:06:02 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:06:02 user nova-compute[75235]:     <system>
Nov 29 19:06:02 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:06:02 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:06:02 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:06:02 user nova-compute[75235]:       <entry name="serial">9d57cb98-5640-4104-ab59-fc0f4786433c</entry>
Nov 29 19:06:02 user nova-compute[75235]:       <entry name="uuid">9d57cb98-5640-4104-ab59-fc0f4786433c</entry>
Nov 29 19:06:02 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:06:02 user nova-compute[75235]:     </system>
Nov 29 19:06:02 user nova-compute[75235]:   </sysinfo>
Nov 29 19:06:02 user nova-compute[75235]:   <os>
Nov 29 19:06:02 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:06:02 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:06:02 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:06:02 user nova-compute[75235]:   </os>
Nov 29 19:06:02 user nova-compute[75235]:   <features>
Nov 29 19:06:02 user nova-compute[75235]:     <acpi/>
Nov 29 19:06:02 user nova-compute[75235]:     <apic/>
Nov 29 19:06:02 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:06:02 user nova-compute[75235]:   </features>
Nov 29 19:06:02 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:06:02 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:06:02 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:06:02 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:06:02 user nova-compute[75235]:   </clock>
Nov 29 19:06:02 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:06:02 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:06:02 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:06:02 user nova-compute[75235]:   </cpu>
Nov 29 19:06:02 user nova-compute[75235]:   <devices>
Nov 29 19:06:02 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:06:02 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:06:02 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk"/>
Nov 29 19:06:02 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:06:02 user nova-compute[75235]:     </disk>
Nov 29 19:06:02 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:06:02 user nova-compute[75235]:       <mac address="fa:16:3e:cd:f3:10"/>
Nov 29 19:06:02 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:02 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:06:02 user nova-compute[75235]:       <target dev="tap5f5671a6-9e"/>
Nov 29 19:06:02 user nova-compute[75235]:     </interface>
Nov 29 19:06:02 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:06:02 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/console.log" append="off"/>
Nov 29 19:06:02 user nova-compute[75235]:     </serial>
Nov 29 19:06:02 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:06:02 user nova-compute[75235]:     <video>
Nov 29 19:06:02 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:02 user nova-compute[75235]:     </video>
Nov 29 19:06:02 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:06:02 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:06:02 user nova-compute[75235]:     </rng>
Nov 29 19:06:02 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:06:02 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:06:02 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:06:02 user nova-compute[75235]:     </memballoon>
Nov 29 19:06:02 user nova-compute[75235]:   </devices>
Nov 29 19:06:02 user nova-compute[75235]: </domain>
Nov 29 19:06:02 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718120687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718120687',id=18,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-80iwsbb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:00Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=9d57cb98-5640-4104-ab59-fc0f4786433c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG os_vif [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c77194d9-08ec-5732-b00c-f9b6dcd1b4d2', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5671a6-9e, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f5671a6-9e, col_values=(('qos', UUID('d880ee6c-aac1-46e3-84be-a316f0d14e06')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f5671a6-9e, col_values=(('external_ids', {'iface-id': '5f5671a6-9e9f-4e2b-9e46-dbd420e435d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:f3:10', 'vm-uuid': '9d57cb98-5640-4104-ab59-fc0f4786433c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:02 user nova-compute[75235]: INFO os_vif [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e')
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No VIF found with MAC fa:16:3e:cd:f3:10, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updated VIF entry in instance network info cache for port 5f5671a6-9e9f-4e2b-9e46-dbd420e435d6. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updating instance_info_cache with network_info: [{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-511fc316-f173-4bf3-8c16-a8915750f7b1 req-ae9ad66d-2b53-4cb2-9bfc-a6c2e7192e33 service nova] Releasing lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-dcf7ee4b-90d6-433b-a881-da654adb6e83 req-6e4ad608-4958-4560-9752-823d90db5292 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dcf7ee4b-90d6-433b-a881-da654adb6e83 req-6e4ad608-4958-4560-9752-823d90db5292 service nova] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dcf7ee4b-90d6-433b-a881-da654adb6e83 req-6e4ad608-4958-4560-9752-823d90db5292 service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dcf7ee4b-90d6-433b-a881-da654adb6e83 req-6e4ad608-4958-4560-9752-823d90db5292 service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-dcf7ee4b-90d6-433b-a881-da654adb6e83 req-6e4ad608-4958-4560-9752-823d90db5292 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] No waiting events found dispatching network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:04 user nova-compute[75235]: WARNING nova.compute.manager [req-dcf7ee4b-90d6-433b-a881-da654adb6e83 req-6e4ad608-4958-4560-9752-823d90db5292 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received unexpected event network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 for instance with vm_state building and task_state spawning.
Nov 29 19:06:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:06:04 user nova-compute[75235]: INFO nova.compute.claims [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Claim successful on node user
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:06:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.policy [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09c7bffe8af741b1b1f2542f543d20e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094885e7831048339ba2cdddd4c67a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:06:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Creating image(s)
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "/opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "/opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "/opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk 1073741824" returned: 0 in 0.060s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Successfully created port: edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:06:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:06:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Instance spawned successfully.
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-c5016d2e-607c-44f3-b332-36f49cae9fef req-e064c18c-dba4-4146-81df-750c12d76845 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c5016d2e-607c-44f3-b332-36f49cae9fef req-e064c18c-dba4-4146-81df-750c12d76845 service nova] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c5016d2e-607c-44f3-b332-36f49cae9fef req-e064c18c-dba4-4146-81df-750c12d76845 service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c5016d2e-607c-44f3-b332-36f49cae9fef req-e064c18c-dba4-4146-81df-750c12d76845 service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-c5016d2e-607c-44f3-b332-36f49cae9fef req-e064c18c-dba4-4146-81df-750c12d76845 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] No waiting events found dispatching network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:06 user nova-compute[75235]: WARNING nova.compute.manager [req-c5016d2e-607c-44f3-b332-36f49cae9fef req-e064c18c-dba4-4146-81df-750c12d76845 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received unexpected event network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 for instance with vm_state building and task_state spawning.
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:06 user nova-compute[75235]: INFO nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Cannot resize image /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Ensure instance console log exists: /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:06 user nova-compute[75235]: INFO nova.compute.manager [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Took 7.59 seconds to build instance.
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5990b2cb-6bd0-490f-acf2-b068d82f57a1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.716s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Successfully updated port: edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "refresh_cache-d55c8d69-fbcb-4513-89a3-cea3e902c3eb" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquired lock "refresh_cache-d55c8d69-fbcb-4513-89a3-cea3e902c3eb" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-changed-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Refreshing instance network info cache due to event network-changed-edff818c-f8dd-4410-bdf5-f80442fcb42d. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] Acquiring lock "refresh_cache-d55c8d69-fbcb-4513-89a3-cea3e902c3eb" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Updating instance_info_cache with network_info: [{"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Releasing lock "refresh_cache-d55c8d69-fbcb-4513-89a3-cea3e902c3eb" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Instance network_info: |[{"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] Acquired lock "refresh_cache-d55c8d69-fbcb-4513-89a3-cea3e902c3eb" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Refreshing network info cache for port edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Start _get_guest_xml network_info=[{"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:06:07 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:07 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1951937975',display_name='tempest-ServersNegativeTestJSON-server-1951937975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1951937975',id=19,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094885e7831048339ba2cdddd4c67a25',ramdisk_id='',reservation_id='r-ykkq3a1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1781487510',owner_user_name='tempest-ServersNegativeTestJSON-1781487510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:05Z,user_data=None,user_id='09c7bffe8af741b1b1f2542f543d20e4',uuid=d55c8d69-fbcb-4513-89a3-cea3e902c3eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converting VIF {"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lazy-loading 'pci_devices' on Instance uuid d55c8d69-fbcb-4513-89a3-cea3e902c3eb {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:06:07 user nova-compute[75235]:   <uuid>d55c8d69-fbcb-4513-89a3-cea3e902c3eb</uuid>
Nov 29 19:06:07 user nova-compute[75235]:   <name>instance-00000013</name>
Nov 29 19:06:07 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:06:07 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:06:07 user nova-compute[75235]:   <metadata>
Nov 29 19:06:07 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:06:07 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:06:07 user nova-compute[75235]:       <nova:name>tempest-ServersNegativeTestJSON-server-1951937975</nova:name>
Nov 29 19:06:07 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:06:07</nova:creationTime>
Nov 29 19:06:07 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:06:07 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:06:07 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:06:07 user nova-compute[75235]:       <nova:owner>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:user uuid="09c7bffe8af741b1b1f2542f543d20e4">tempest-ServersNegativeTestJSON-1781487510-project-member</nova:user>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:project uuid="094885e7831048339ba2cdddd4c67a25">tempest-ServersNegativeTestJSON-1781487510</nova:project>
Nov 29 19:06:07 user nova-compute[75235]:       </nova:owner>
Nov 29 19:06:07 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:06:07 user nova-compute[75235]:       <nova:ports>
Nov 29 19:06:07 user nova-compute[75235]:         <nova:port uuid="edff818c-f8dd-4410-bdf5-f80442fcb42d">
Nov 29 19:06:07 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:06:07 user nova-compute[75235]:         </nova:port>
Nov 29 19:06:07 user nova-compute[75235]:       </nova:ports>
Nov 29 19:06:07 user nova-compute[75235]:     </nova:instance>
Nov 29 19:06:07 user nova-compute[75235]:   </metadata>
Nov 29 19:06:07 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:06:07 user nova-compute[75235]:     <system>
Nov 29 19:06:07 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:06:07 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:06:07 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:06:07 user nova-compute[75235]:       <entry name="serial">d55c8d69-fbcb-4513-89a3-cea3e902c3eb</entry>
Nov 29 19:06:07 user nova-compute[75235]:       <entry name="uuid">d55c8d69-fbcb-4513-89a3-cea3e902c3eb</entry>
Nov 29 19:06:07 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:06:07 user nova-compute[75235]:     </system>
Nov 29 19:06:07 user nova-compute[75235]:   </sysinfo>
Nov 29 19:06:07 user nova-compute[75235]:   <os>
Nov 29 19:06:07 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:06:07 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:06:07 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:06:07 user nova-compute[75235]:   </os>
Nov 29 19:06:07 user nova-compute[75235]:   <features>
Nov 29 19:06:07 user nova-compute[75235]:     <acpi/>
Nov 29 19:06:07 user nova-compute[75235]:     <apic/>
Nov 29 19:06:07 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:06:07 user nova-compute[75235]:   </features>
Nov 29 19:06:07 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:06:07 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:06:07 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:06:07 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:06:07 user nova-compute[75235]:   </clock>
Nov 29 19:06:07 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:06:07 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:06:07 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:06:07 user nova-compute[75235]:   </cpu>
Nov 29 19:06:07 user nova-compute[75235]:   <devices>
Nov 29 19:06:07 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:06:07 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:06:07 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk"/>
Nov 29 19:06:07 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:06:07 user nova-compute[75235]:     </disk>
Nov 29 19:06:07 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:06:07 user nova-compute[75235]:       <mac address="fa:16:3e:86:7c:de"/>
Nov 29 19:06:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:07 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:06:07 user nova-compute[75235]:       <target dev="tapedff818c-f8"/>
Nov 29 19:06:07 user nova-compute[75235]:     </interface>
Nov 29 19:06:07 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:06:07 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/console.log" append="off"/>
Nov 29 19:06:07 user nova-compute[75235]:     </serial>
Nov 29 19:06:07 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:06:07 user nova-compute[75235]:     <video>
Nov 29 19:06:07 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:07 user nova-compute[75235]:     </video>
Nov 29 19:06:07 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:06:07 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:06:07 user nova-compute[75235]:     </rng>
Nov 29 19:06:07 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:06:07 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:06:07 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:06:07 user nova-compute[75235]:     </memballoon>
Nov 29 19:06:07 user nova-compute[75235]:   </devices>
Nov 29 19:06:07 user nova-compute[75235]: </domain>
Nov 29 19:06:07 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1951937975',display_name='tempest-ServersNegativeTestJSON-server-1951937975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1951937975',id=19,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094885e7831048339ba2cdddd4c67a25',ramdisk_id='',reservation_id='r-ykkq3a1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1781487510',owner_user_name='tempest-ServersNegativeTestJSON-1781487510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:05Z,user_data=None,user_id='09c7bffe8af741b1b1f2542f543d20e4',uuid=d55c8d69-fbcb-4513-89a3-cea3e902c3eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converting VIF {"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG os_vif [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd36dd7e9-33aa-5fbd-baf9-491bb5f05bdc', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedff818c-f8, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedff818c-f8, col_values=(('qos', UUID('019f0942-a165-4aed-9a29-11f83be4dc3b')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedff818c-f8, col_values=(('external_ids', {'iface-id': 'edff818c-f8dd-4410-bdf5-f80442fcb42d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:7c:de', 'vm-uuid': 'd55c8d69-fbcb-4513-89a3-cea3e902c3eb'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:07 user nova-compute[75235]: INFO os_vif [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8')
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] No VIF found with MAC fa:16:3e:86:7c:de, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Updated VIF entry in instance network info cache for port edff818c-f8dd-4410-bdf5-f80442fcb42d. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Updating instance_info_cache with network_info: [{"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f576f5c1-5712-4307-8c8c-51415269ba65 req-99e605e9-309b-46fa-aa6d-0a16f13f80fd service nova] Releasing lock "refresh_cache-d55c8d69-fbcb-4513-89a3-cea3e902c3eb" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-d13430ff-3244-426a-9167-07c4447dc3c0 req-b682900f-a884-44fd-944d-1d7bc62416ef service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d13430ff-3244-426a-9167-07c4447dc3c0 req-b682900f-a884-44fd-944d-1d7bc62416ef service nova] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d13430ff-3244-426a-9167-07c4447dc3c0 req-b682900f-a884-44fd-944d-1d7bc62416ef service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d13430ff-3244-426a-9167-07c4447dc3c0 req-b682900f-a884-44fd-944d-1d7bc62416ef service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-d13430ff-3244-426a-9167-07c4447dc3c0 req-b682900f-a884-44fd-944d-1d7bc62416ef service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] No waiting events found dispatching network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:09 user nova-compute[75235]: WARNING nova.compute.manager [req-d13430ff-3244-426a-9167-07c4447dc3c0 req-b682900f-a884-44fd-944d-1d7bc62416ef service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received unexpected event network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d for instance with vm_state building and task_state spawning.
Nov 29 19:06:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-972a38b9-eab7-4409-9cee-3c280ea09ffd req-e733e479-a1a8-4e00-94c0-2b519fed1d52 service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-972a38b9-eab7-4409-9cee-3c280ea09ffd req-e733e479-a1a8-4e00-94c0-2b519fed1d52 service nova] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-972a38b9-eab7-4409-9cee-3c280ea09ffd req-e733e479-a1a8-4e00-94c0-2b519fed1d52 service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-972a38b9-eab7-4409-9cee-3c280ea09ffd req-e733e479-a1a8-4e00-94c0-2b519fed1d52 service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-972a38b9-eab7-4409-9cee-3c280ea09ffd req-e733e479-a1a8-4e00-94c0-2b519fed1d52 service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] No waiting events found dispatching network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:11 user nova-compute[75235]: WARNING nova.compute.manager [req-972a38b9-eab7-4409-9cee-3c280ea09ffd req-e733e479-a1a8-4e00-94c0-2b519fed1d52 service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received unexpected event network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d for instance with vm_state building and task_state spawning.
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:06:11 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Instance spawned successfully.
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:11 user nova-compute[75235]: INFO nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 29 19:06:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:06:11 user nova-compute[75235]: INFO nova.compute.manager [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Took 6.91 seconds to build instance.
Nov 29 19:06:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0c6c9a8b-aedb-42af-9c50-658929351cf4 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.020s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:18 user nova-compute[75235]: INFO nova.compute.manager [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Terminating instance
Nov 29 19:06:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-107680d2-b8b7-4db9-99d2-28ed5a2bacd2 req-5f41f0e7-1706-4952-905c-927ef8277d2b service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-vif-unplugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-107680d2-b8b7-4db9-99d2-28ed5a2bacd2 req-5f41f0e7-1706-4952-905c-927ef8277d2b service nova] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-107680d2-b8b7-4db9-99d2-28ed5a2bacd2 req-5f41f0e7-1706-4952-905c-927ef8277d2b service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-107680d2-b8b7-4db9-99d2-28ed5a2bacd2 req-5f41f0e7-1706-4952-905c-927ef8277d2b service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-107680d2-b8b7-4db9-99d2-28ed5a2bacd2 req-5f41f0e7-1706-4952-905c-927ef8277d2b service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] No waiting events found dispatching network-vif-unplugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-107680d2-b8b7-4db9-99d2-28ed5a2bacd2 req-5f41f0e7-1706-4952-905c-927ef8277d2b service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-vif-unplugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Instance destroyed successfully.
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'resources' on Instance uuid 05533a2c-8f8e-4bfd-8b36-92470a10d5e6 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1179164610',display_name='tempest-VolumesAdminNegativeTest-server-1179164610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1179164610',id=14,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:04:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbbea24130784a9fbd5a9572e30b3094',ramdisk_id='',reservation_id='r-tx3ecqse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1338291818',owner_user_name='tempest-VolumesAdminNegativeTest-1338291818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:04:26Z,user_data=None,user_id='8f516b841e854f1dbc8518c1e346fb0d',uuid=05533a2c-8f8e-4bfd-8b36-92470a10d5e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converting VIF {"id": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "address": "fa:16:3e:f5:ee:2e", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da2823a-d6", "ovs_interfaceid": "4da2823a-d6fa-4e92-8f74-21ba3aa0666d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG os_vif [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4da2823a-d6, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f2d078-6962-4373-ba4e-5ff5d7ee154e) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:19 user nova-compute[75235]: INFO os_vif [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:2e,bridge_name='br-int',has_traffic_filtering=True,id=4da2823a-d6fa-4e92-8f74-21ba3aa0666d,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da2823a-d6')
Nov 29 19:06:19 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Deleting instance files /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6_del
Nov 29 19:06:19 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Deletion of /opt/stack/data/nova/instances/05533a2c-8f8e-4bfd-8b36-92470a10d5e6_del complete
Nov 29 19:06:19 user nova-compute[75235]: INFO nova.compute.manager [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 19:06:19 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:06:19 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:20 user nova-compute[75235]: INFO nova.compute.manager [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Terminating instance
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:20 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Took 0.66 seconds to deallocate network for instance.
Nov 29 19:06:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-464b5ce0-6e3e-4db0-a185-07980e40c9ce req-3cf97f2c-e047-4458-ba79-1d20a8110527 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-vif-deleted-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-3e61b70b-d897-4793-89c5-8243d122e3bf req-5dfdf280-2166-452d-9131-7caa85b97ed9 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-vif-unplugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3e61b70b-d897-4793-89c5-8243d122e3bf req-5dfdf280-2166-452d-9131-7caa85b97ed9 service nova] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3e61b70b-d897-4793-89c5-8243d122e3bf req-5dfdf280-2166-452d-9131-7caa85b97ed9 service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3e61b70b-d897-4793-89c5-8243d122e3bf req-5dfdf280-2166-452d-9131-7caa85b97ed9 service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-3e61b70b-d897-4793-89c5-8243d122e3bf req-5dfdf280-2166-452d-9131-7caa85b97ed9 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] No waiting events found dispatching network-vif-unplugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-3e61b70b-d897-4793-89c5-8243d122e3bf req-5dfdf280-2166-452d-9131-7caa85b97ed9 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-vif-unplugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:06:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Instance destroyed successfully.
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'resources' on Instance uuid aa2da6c4-f2d2-4598-9113-122b3ca34133 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2004234973',display_name='tempest-AttachVolumeTestJSON-server-2004234973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2004234973',id=2,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmUpOJrJWlPMvnNzLYyWWwSlNtxXqeK5V+hnbPZK2L89PubR9MExqLj0fZnBLGLlP/YVa7e2/OpEoyimOMmHLLvvea/oslu7wRjgyoe9YoyRqApOc2qlktow2iDCyt2cw==',key_name='tempest-keypair-508237282',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f675723ce844bf5ae965d0b53ae439d',ramdisk_id='',reservation_id='r-cho0j1i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430085223',owner_user_name='tempest-AttachVolumeTestJSON-1430085223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2babb226c484046aab50a159bf20ef4',uuid=aa2da6c4-f2d2-4598-9113-122b3ca34133,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converting VIF {"id": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "address": "fa:16:3e:9f:b0:eb", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584745e-bf", "ovs_interfaceid": "d584745e-bfef-470a-8b88-a43e1f3d3f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:20 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG os_vif [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd584745e-bf, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ef49749-e99a-4ae0-80ec-fd60ebfa8840) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:21 user nova-compute[75235]: INFO os_vif [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:b0:eb,bridge_name='br-int',has_traffic_filtering=True,id=d584745e-bfef-470a-8b88-a43e1f3d3f2b,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584745e-bf')
Nov 29 19:06:21 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Deleting instance files /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133_del
Nov 29 19:06:21 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Deletion of /opt/stack/data/nova/instances/aa2da6c4-f2d2-4598-9113-122b3ca34133_del complete
Nov 29 19:06:21 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.643s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:21 user nova-compute[75235]: INFO nova.compute.manager [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 29 19:06:21 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:06:21 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Deleted allocations for instance 05533a2c-8f8e-4bfd-8b36-92470a10d5e6
Nov 29 19:06:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b9fc219-db3d-446c-a645-4ebe42e834c2 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.450s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-50887a40-421c-4b08-8699-5eca28b6d3a7 req-2d66f530-8ab6-4c13-a172-4961df88b7a7 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received event network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-50887a40-421c-4b08-8699-5eca28b6d3a7 req-2d66f530-8ab6-4c13-a172-4961df88b7a7 service nova] Acquiring lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-50887a40-421c-4b08-8699-5eca28b6d3a7 req-2d66f530-8ab6-4c13-a172-4961df88b7a7 service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-50887a40-421c-4b08-8699-5eca28b6d3a7 req-2d66f530-8ab6-4c13-a172-4961df88b7a7 service nova] Lock "05533a2c-8f8e-4bfd-8b36-92470a10d5e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-50887a40-421c-4b08-8699-5eca28b6d3a7 req-2d66f530-8ab6-4c13-a172-4961df88b7a7 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] No waiting events found dispatching network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:21 user nova-compute[75235]: WARNING nova.compute.manager [req-50887a40-421c-4b08-8699-5eca28b6d3a7 req-2d66f530-8ab6-4c13-a172-4961df88b7a7 service nova] [instance: 05533a2c-8f8e-4bfd-8b36-92470a10d5e6] Received unexpected event network-vif-plugged-4da2823a-d6fa-4e92-8f74-21ba3aa0666d for instance with vm_state deleted and task_state None.
Nov 29 19:06:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-e82770f9-92fa-4d7c-b389-6f5d401cb7d6 req-79bce9dc-d34c-47c0-8d23-097c7d8151a7 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e82770f9-92fa-4d7c-b389-6f5d401cb7d6 req-79bce9dc-d34c-47c0-8d23-097c7d8151a7 service nova] Acquiring lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e82770f9-92fa-4d7c-b389-6f5d401cb7d6 req-79bce9dc-d34c-47c0-8d23-097c7d8151a7 service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e82770f9-92fa-4d7c-b389-6f5d401cb7d6 req-79bce9dc-d34c-47c0-8d23-097c7d8151a7 service nova] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-e82770f9-92fa-4d7c-b389-6f5d401cb7d6 req-79bce9dc-d34c-47c0-8d23-097c7d8151a7 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] No waiting events found dispatching network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:22 user nova-compute[75235]: WARNING nova.compute.manager [req-e82770f9-92fa-4d7c-b389-6f5d401cb7d6 req-79bce9dc-d34c-47c0-8d23-097c7d8151a7 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received unexpected event network-vif-plugged-d584745e-bfef-470a-8b88-a43e1f3d3f2b for instance with vm_state active and task_state deleting.
Nov 29 19:06:22 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-5758ac07-91fa-4c7c-ba16-486a29f773da req-c34458c3-ec15-46c6-8ced-a81d5d1f1aa5 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Received event network-vif-deleted-d584745e-bfef-470a-8b88-a43e1f3d3f2b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:22 user nova-compute[75235]: INFO nova.compute.manager [req-5758ac07-91fa-4c7c-ba16-486a29f773da req-c34458c3-ec15-46c6-8ced-a81d5d1f1aa5 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Neutron deleted interface d584745e-bfef-470a-8b88-a43e1f3d3f2b; detaching it from the instance and deleting it from the info cache
Nov 29 19:06:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-5758ac07-91fa-4c7c-ba16-486a29f773da req-c34458c3-ec15-46c6-8ced-a81d5d1f1aa5 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:22 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Took 1.87 seconds to deallocate network for instance.
Nov 29 19:06:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-5758ac07-91fa-4c7c-ba16-486a29f773da req-c34458c3-ec15-46c6-8ced-a81d5d1f1aa5 service nova] [instance: aa2da6c4-f2d2-4598-9113-122b3ca34133] Detach interface failed, port_id=d584745e-bfef-470a-8b88-a43e1f3d3f2b, reason: Instance aa2da6c4-f2d2-4598-9113-122b3ca34133 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:06:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:23 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:06:23 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:06:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:23 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Deleted allocations for instance aa2da6c4-f2d2-4598-9113-122b3ca34133
Nov 29 19:06:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ef809ad4-2609-4802-8b6e-0d1617cea92f tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "aa2da6c4-f2d2-4598-9113-122b3ca34133" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.617s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:06:41 user nova-compute[75235]: INFO nova.compute.claims [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Claim successful on node user
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:06:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.policy [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1fe2271d5ad4b97acdbfcd699e3829a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ccc9827eb540868fea8b5891c75338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:06:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Creating image(s)
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk 1073741824" returned: 0 in 0.056s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Successfully created port: 644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.204s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Cannot resize image /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Ensure instance console log exists: /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Successfully updated port: 644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-changed-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Refreshing instance network info cache due to event network-changed-644e59e3-44e4-43e5-8d47-a226b1457182. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance network_info: |[{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.neutron [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Refreshing network info cache for port 644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start _get_guest_xml network_info=[{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:06:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'pci_devices' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:06:44 user nova-compute[75235]:   <uuid>667a5ca0-f308-4eb9-a025-14c49ff25eb3</uuid>
Nov 29 19:06:44 user nova-compute[75235]:   <name>instance-00000014</name>
Nov 29 19:06:44 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:06:44 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:06:44 user nova-compute[75235]:   <metadata>
Nov 29 19:06:44 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:06:44 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:06:44 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherB-server-2026348765</nova:name>
Nov 29 19:06:44 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:06:44</nova:creationTime>
Nov 29 19:06:44 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:06:44 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:06:44 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:06:44 user nova-compute[75235]:       <nova:owner>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:user uuid="b1fe2271d5ad4b97acdbfcd699e3829a">tempest-ServerActionsTestOtherB-1405811153-project-member</nova:user>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:project uuid="52ccc9827eb540868fea8b5891c75338">tempest-ServerActionsTestOtherB-1405811153</nova:project>
Nov 29 19:06:44 user nova-compute[75235]:       </nova:owner>
Nov 29 19:06:44 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:06:44 user nova-compute[75235]:       <nova:ports>
Nov 29 19:06:44 user nova-compute[75235]:         <nova:port uuid="644e59e3-44e4-43e5-8d47-a226b1457182">
Nov 29 19:06:44 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:06:44 user nova-compute[75235]:         </nova:port>
Nov 29 19:06:44 user nova-compute[75235]:       </nova:ports>
Nov 29 19:06:44 user nova-compute[75235]:     </nova:instance>
Nov 29 19:06:44 user nova-compute[75235]:   </metadata>
Nov 29 19:06:44 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:06:44 user nova-compute[75235]:     <system>
Nov 29 19:06:44 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:06:44 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:06:44 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:06:44 user nova-compute[75235]:       <entry name="serial">667a5ca0-f308-4eb9-a025-14c49ff25eb3</entry>
Nov 29 19:06:44 user nova-compute[75235]:       <entry name="uuid">667a5ca0-f308-4eb9-a025-14c49ff25eb3</entry>
Nov 29 19:06:44 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:06:44 user nova-compute[75235]:     </system>
Nov 29 19:06:44 user nova-compute[75235]:   </sysinfo>
Nov 29 19:06:44 user nova-compute[75235]:   <os>
Nov 29 19:06:44 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:06:44 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:06:44 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:06:44 user nova-compute[75235]:   </os>
Nov 29 19:06:44 user nova-compute[75235]:   <features>
Nov 29 19:06:44 user nova-compute[75235]:     <acpi/>
Nov 29 19:06:44 user nova-compute[75235]:     <apic/>
Nov 29 19:06:44 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:06:44 user nova-compute[75235]:   </features>
Nov 29 19:06:44 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:06:44 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:06:44 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:06:44 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:06:44 user nova-compute[75235]:   </clock>
Nov 29 19:06:44 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:06:44 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:06:44 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:06:44 user nova-compute[75235]:   </cpu>
Nov 29 19:06:44 user nova-compute[75235]:   <devices>
Nov 29 19:06:44 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:06:44 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:06:44 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk"/>
Nov 29 19:06:44 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:06:44 user nova-compute[75235]:     </disk>
Nov 29 19:06:44 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:06:44 user nova-compute[75235]:       <mac address="fa:16:3e:b2:6a:b3"/>
Nov 29 19:06:44 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:44 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:06:44 user nova-compute[75235]:       <target dev="tap644e59e3-44"/>
Nov 29 19:06:44 user nova-compute[75235]:     </interface>
Nov 29 19:06:44 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:06:44 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/console.log" append="off"/>
Nov 29 19:06:44 user nova-compute[75235]:     </serial>
Nov 29 19:06:44 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:06:44 user nova-compute[75235]:     <video>
Nov 29 19:06:44 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:44 user nova-compute[75235]:     </video>
Nov 29 19:06:44 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:06:44 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:06:44 user nova-compute[75235]:     </rng>
Nov 29 19:06:44 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:06:44 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:06:44 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:06:44 user nova-compute[75235]:     </memballoon>
Nov 29 19:06:44 user nova-compute[75235]:   </devices>
Nov 29 19:06:44 user nova-compute[75235]: </domain>
Nov 29 19:06:44 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG os_vif [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfe2b9fa-0f48-5676-be48-63a3859e3c28', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap644e59e3-44, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap644e59e3-44, col_values=(('qos', UUID('3c273617-22dc-4f72-9528-cfa4ab161605')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap644e59e3-44, col_values=(('external_ids', {'iface-id': '644e59e3-44e4-43e5-8d47-a226b1457182', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:6a:b3', 'vm-uuid': '667a5ca0-f308-4eb9-a025-14c49ff25eb3'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:44 user nova-compute[75235]: INFO os_vif [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44')
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:06:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No VIF found with MAC fa:16:3e:b2:6a:b3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG nova.network.neutron [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updated VIF entry in instance network info cache for port 644e59e3-44e4-43e5-8d47-a226b1457182. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG nova.network.neutron [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-762b1980-1a1b-48f7-be91-be927fa0ebed req-cd25fa32-d956-4bf3-b254-22edd7cf9410 service nova] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:45 user nova-compute[75235]: INFO nova.compute.manager [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Detaching volume 2c6b30c1-aadb-444b-b17e-1c01b3e269a3
Nov 29 19:06:45 user nova-compute[75235]: INFO nova.virt.block_device [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Attempting to driver detach volume 2c6b30c1-aadb-444b-b17e-1c01b3e269a3 from mountpoint /dev/vdc
Nov 29 19:06:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Attempting to detach device vdc from instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:06:45 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:06:45 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:06:45 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:06:45 user nova-compute[75235]:   <serial>2c6b30c1-aadb-444b-b17e-1c01b3e269a3</serial>
Nov 29 19:06:45 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 19:06:45 user nova-compute[75235]: </disk>
Nov 29 19:06:45 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:06:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully detached device vdc from instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 from the persistent domain config.
Nov 29 19:06:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:06:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:06:45 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:06:45 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:06:45 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:06:45 user nova-compute[75235]:   <serial>2c6b30c1-aadb-444b-b17e-1c01b3e269a3</serial>
Nov 29 19:06:45 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 19:06:45 user nova-compute[75235]: </disk>
Nov 29 19:06:45 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:06:46 user nova-compute[75235]: INFO nova.compute.claims [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Claim successful on node user
Nov 29 19:06:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-06b5e88b-104c-4bf3-af1d-7fd9ee10dc1d req-a4825b21-e6af-4e9c-9817-ec4094577785 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-06b5e88b-104c-4bf3-af1d-7fd9ee10dc1d req-a4825b21-e6af-4e9c-9817-ec4094577785 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-06b5e88b-104c-4bf3-af1d-7fd9ee10dc1d req-a4825b21-e6af-4e9c-9817-ec4094577785 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-06b5e88b-104c-4bf3-af1d-7fd9ee10dc1d req-a4825b21-e6af-4e9c-9817-ec4094577785 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-06b5e88b-104c-4bf3-af1d-7fd9ee10dc1d req-a4825b21-e6af-4e9c-9817-ec4094577785 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:46 user nova-compute[75235]: WARNING nova.compute.manager [req-06b5e88b-104c-4bf3-af1d-7fd9ee10dc1d req-a4825b21-e6af-4e9c-9817-ec4094577785 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state building and task_state spawning.
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-changed-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Refreshing instance network info cache due to event network-changed-f8907cc3-5fa0-46bf-860f-250eaa8181e8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] Acquiring lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] Acquired lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Refreshing network info cache for port f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:47 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:06:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.policy [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82dcae401a574847b3262ee209963897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f47892237b941b5a5c3907e0fda8833', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:06:47 user nova-compute[75235]: INFO nova.virt.block_device [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Booting with volume 8693a058-3366-457b-800f-8db54e05e50a at /dev/vda
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'flavor' on Instance uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG os_brick.utils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[613bfc6b-3f5b-427f-b411-bae372c50173]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786096b-3c3a-4092-8b00-5d254b6fd739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc331d-d2f8-4be9-8250-6a4b5c673b65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d9055b-5451-455e-868a-aaff5757cbb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:06:47 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c79f0e-c46e-4e49-9e7e-b130e8793cb9]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG os_brick.utils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updating existing volume attachment record: f7a84d7c-474f-4b0f-8c26-3d5741a793da {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:47 user nova-compute[75235]: INFO nova.compute.manager [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attaching volume 0fd14c51-11de-4f1c-b312-f13d97fbd3d1 to /dev/vdb
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updated VIF entry in instance network info cache for port f8907cc3-5fa0-46bf-860f-250eaa8181e8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating instance_info_cache with network_info: [{"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG os_brick.utils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-70586f61-7cdd-4af0-a7f3-bbbcb6fc17c9 req-c21268ea-8bdb-4e70-9ed0-228420914251 service nova] Releasing lock "refresh_cache-0e7eb484-033e-4a7a-a259-a183e78a6b96" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b2f237-905e-4048-a3b7-c50c22ccfaf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0318e74d-7daf-4f3f-aef9-8f8273720d0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbab77-b7ec-4d4c-afeb-4ce6754cc6ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a505d19d-4ac5-4099-a64a-1b3dc5547c7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:06:48 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a3e015-f4b1-4d06-ba3b-098e39dc82cf]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG os_brick.utils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating existing volume attachment record: a67b2a7a-1af7-44ae-a217-ed4b961e9272 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Successfully created port: 97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-abb23024-1e55-44fe-85a7-cbf716480f31 req-6e6e781d-6614-4925-8fcf-5c326049c690 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-abb23024-1e55-44fe-85a7-cbf716480f31 req-6e6e781d-6614-4925-8fcf-5c326049c690 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-abb23024-1e55-44fe-85a7-cbf716480f31 req-6e6e781d-6614-4925-8fcf-5c326049c690 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-abb23024-1e55-44fe-85a7-cbf716480f31 req-6e6e781d-6614-4925-8fcf-5c326049c690 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-abb23024-1e55-44fe-85a7-cbf716480f31 req-6e6e781d-6614-4925-8fcf-5c326049c690 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:48 user nova-compute[75235]: WARNING nova.compute.manager [req-abb23024-1e55-44fe-85a7-cbf716480f31 req-6e6e781d-6614-4925-8fcf-5c326049c690 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state building and task_state spawning.
Nov 29 19:06:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance spawned successfully.
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:06:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Successfully updated port: 97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:06:49 user nova-compute[75235]: INFO nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquired lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-changed-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Refreshing instance network info cache due to event network-changed-97293492-a506-48cb-aa5a-2cba15a33988. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] Acquiring lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:06:49 user nova-compute[75235]: INFO nova.compute.manager [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Took 7.19 seconds to build instance.
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9a9494c5-fd3e-4dee-ba17-395f87ccbb79 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.309s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updating instance_info_cache with network_info: [{"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Releasing lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance network_info: |[{"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] Acquired lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Refreshing network info cache for port 97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updated VIF entry in instance network info cache for port 97293492-a506-48cb-aa5a-2cba15a33988. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG nova.network.neutron [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updating instance_info_cache with network_info: [{"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b6cc2021-0b0c-4c93-8a58-80ba6240ffb6 req-6306ed26-72d0-4f9f-9018-9048b65e645e service nova] Releasing lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:06:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:53 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:53 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:53 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7214MB free_disk=25.328723907470703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 03f7d056-56b5-45ba-a6e1-3449e35b9728 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance d55c8d69-fbcb-4513-89a3-cea3e902c3eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 68da4f22-a767-4f82-a0fa-e757d8437c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.943s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:06:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:06:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Creating image(s)
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Start _get_guest_xml network_info=[{"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f7a84d7c-474f-4b0f-8c26-3d5741a793da', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68da4f22-a767-4f82-a0fa-e757d8437c1d', 'attached_at': '', 'detached_at': '', 'volume_id': '8693a058-3366-457b-800f-8db54e05e50a', 'serial': '8693a058-3366-457b-800f-8db54e05e50a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:06:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:06:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:06:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:06:56 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2819567-5d34-4a57-92db-622771ae428c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:06:56 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe03945-066d-4032-b106-d37a6b9fa449]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a] added
Nov 29 19:06:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3b568-0fd2-4f00-a6bd-e7fb3637d456]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0455aed4-e935-40dd-98a9-bef47be6f38d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwnmWAhH {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwnmWAhH" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb200e-625b-44fe-8af7-76b3e6e8126e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SwnmWAhH'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92a26b0-54e3-4eb7-8ae5-64dee7b691ee]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:06:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b707f9-aa25-48a7-b8b2-a697798406b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:56 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:56 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:56 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:56 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a8a25-ee94-4b33-8898-1883c1120cee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]
Nov 29 19:06:57 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.
Nov 29 19:06:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6525c9-1fbc-4a44-aad5-34fa2b7ed6a1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0c8b84-cfd7-4d5a-a11a-33679eca547f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:57 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:57 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:57 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:06:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:57 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:57 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:57 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:06:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4263c-7bf8-4377-8d0c-3957e8bb756a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:06:57 user nova-compute[75235]: INFO nova.compute.manager [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Unrescuing
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26664663665376233', 'path': '/dev/sde'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664663665376233', 'path': '/dev/sde'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.201s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:06:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:06:58 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7dfdc5-47ec-49e6-8b63-7987c70f3319]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:06:58 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1047567644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1047567644',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI66VmULyd9ckKxIHCFeqsXCYg/QSiaHvW1iAxP1EMxJ/4CTxOTWXE/izpcbRPZjsIXsx+mjuN86ozzO8VxEQ8qrf2Qje0qP6MElQeVrdKCkA7YqK6sFocX0Lkbu/6+sw==',key_name='tempest-keypair-471369165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f47892237b941b5a5c3907e0fda8833',ramdisk_id='',reservation_id='r-cq80ikws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2075615192',owner_user_name='tempest-ServerActionsV293TestJSON-2075615192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82dcae401a574847b3262ee209963897',uuid=68da4f22-a767-4f82-a0fa-e757d8437c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converting VIF {"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lazy-loading 'pci_devices' on Instance uuid 68da4f22-a767-4f82-a0fa-e757d8437c1d {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:06:58 user nova-compute[75235]:   <uuid>68da4f22-a767-4f82-a0fa-e757d8437c1d</uuid>
Nov 29 19:06:58 user nova-compute[75235]:   <name>instance-00000015</name>
Nov 29 19:06:58 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:06:58 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:06:58 user nova-compute[75235]:   <metadata>
Nov 29 19:06:58 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:06:58 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:06:58 user nova-compute[75235]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1047567644</nova:name>
Nov 29 19:06:58 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:06:56</nova:creationTime>
Nov 29 19:06:58 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:06:58 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:06:58 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:06:58 user nova-compute[75235]:       <nova:owner>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:user uuid="82dcae401a574847b3262ee209963897">tempest-ServerActionsV293TestJSON-2075615192-project-member</nova:user>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:project uuid="3f47892237b941b5a5c3907e0fda8833">tempest-ServerActionsV293TestJSON-2075615192</nova:project>
Nov 29 19:06:58 user nova-compute[75235]:       </nova:owner>
Nov 29 19:06:58 user nova-compute[75235]:       <nova:ports>
Nov 29 19:06:58 user nova-compute[75235]:         <nova:port uuid="97293492-a506-48cb-aa5a-2cba15a33988">
Nov 29 19:06:58 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:06:58 user nova-compute[75235]:         </nova:port>
Nov 29 19:06:58 user nova-compute[75235]:       </nova:ports>
Nov 29 19:06:58 user nova-compute[75235]:     </nova:instance>
Nov 29 19:06:58 user nova-compute[75235]:   </metadata>
Nov 29 19:06:58 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:06:58 user nova-compute[75235]:     <system>
Nov 29 19:06:58 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:06:58 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:06:58 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:06:58 user nova-compute[75235]:       <entry name="serial">68da4f22-a767-4f82-a0fa-e757d8437c1d</entry>
Nov 29 19:06:58 user nova-compute[75235]:       <entry name="uuid">68da4f22-a767-4f82-a0fa-e757d8437c1d</entry>
Nov 29 19:06:58 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:06:58 user nova-compute[75235]:     </system>
Nov 29 19:06:58 user nova-compute[75235]:   </sysinfo>
Nov 29 19:06:58 user nova-compute[75235]:   <os>
Nov 29 19:06:58 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:06:58 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:06:58 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:06:58 user nova-compute[75235]:   </os>
Nov 29 19:06:58 user nova-compute[75235]:   <features>
Nov 29 19:06:58 user nova-compute[75235]:     <acpi/>
Nov 29 19:06:58 user nova-compute[75235]:     <apic/>
Nov 29 19:06:58 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:06:58 user nova-compute[75235]:   </features>
Nov 29 19:06:58 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:06:58 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:06:58 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:06:58 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:06:58 user nova-compute[75235]:   </clock>
Nov 29 19:06:58 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:06:58 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:06:58 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:06:58 user nova-compute[75235]:   </cpu>
Nov 29 19:06:58 user nova-compute[75235]:   <devices>
Nov 29 19:06:58 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:06:58 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:06:58 user nova-compute[75235]:       <source dev="/dev/sde"/>
Nov 29 19:06:58 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:06:58 user nova-compute[75235]:       <serial>8693a058-3366-457b-800f-8db54e05e50a</serial>
Nov 29 19:06:58 user nova-compute[75235]:     </disk>
Nov 29 19:06:58 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:06:58 user nova-compute[75235]:       <mac address="fa:16:3e:8c:6e:e4"/>
Nov 29 19:06:58 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:58 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:06:58 user nova-compute[75235]:       <target dev="tap97293492-a5"/>
Nov 29 19:06:58 user nova-compute[75235]:     </interface>
Nov 29 19:06:58 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:06:58 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d/console.log" append="off"/>
Nov 29 19:06:58 user nova-compute[75235]:     </serial>
Nov 29 19:06:58 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:06:58 user nova-compute[75235]:     <video>
Nov 29 19:06:58 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:06:58 user nova-compute[75235]:     </video>
Nov 29 19:06:58 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:06:58 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:06:58 user nova-compute[75235]:     </rng>
Nov 29 19:06:58 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:06:58 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:06:58 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:06:58 user nova-compute[75235]:     </memballoon>
Nov 29 19:06:58 user nova-compute[75235]:   </devices>
Nov 29 19:06:58 user nova-compute[75235]: </domain>
Nov 29 19:06:58 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1047567644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1047567644',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI66VmULyd9ckKxIHCFeqsXCYg/QSiaHvW1iAxP1EMxJ/4CTxOTWXE/izpcbRPZjsIXsx+mjuN86ozzO8VxEQ8qrf2Qje0qP6MElQeVrdKCkA7YqK6sFocX0Lkbu/6+sw==',key_name='tempest-keypair-471369165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f47892237b941b5a5c3907e0fda8833',ramdisk_id='',reservation_id='r-cq80ikws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-2075615192',owner_user_name='tempest-ServerActionsV293TestJSON-2075615192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82dcae401a574847b3262ee209963897',uuid=68da4f22-a767-4f82-a0fa-e757d8437c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converting VIF {"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_vif [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4546ce4c-f318-5a81-85a4-3f554a594cc7', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c2936-3d73-4b96-97d1-ba68a5b791fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1] added
Nov 29 19:06:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97293492-a5, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97293492-a5, col_values=(('qos', UUID('4b5b0bae-2808-4a72-9c75-e93108f9bba4')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97293492-a5, col_values=(('external_ids', {'iface-id': '97293492-a506-48cb-aa5a-2cba15a33988', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:6e:e4', 'vm-uuid': '68da4f22-a767-4f82-a0fa-e757d8437c1d'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeb90fd-20f1-46fa-a3c3-9435d3413d3a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: INFO os_vif [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5')
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71cf729-ca75-49de-a26c-5f0d2693e158]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjRWmMJY {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjRWmMJY" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[503981a3-e569-4c5c-a711-bb3f67d61663]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjRWmMJY'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] No VIF found with MAC fa:16:3e:8c:6e:e4, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2328dd45-02d2-4a15-8140-2536289f6cd9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[77313dbf-9f57-44e7-8580-9ab7be118250]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:06:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:06:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ed3e2-0ca2-4f13-9d0a-40998e046727]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]
Nov 29 19:06:58 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.
Nov 29 19:06:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f997a-680b-4097-9cca-4d4e3d8921dd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ff3cb-5eb1-44fa-8031-94cbc83837a7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:06:58 user nova-compute[75235]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:06:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[86902c3c-057a-4feb-ad92-4015542ec849]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'flavor' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing instance network info cache due to event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:06:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-fd276c3e-2ee5-4bd7-92ae-ddc205bde555 req-d52f016a-b306-40f3-8890-a4d51cade202 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fd276c3e-2ee5-4bd7-92ae-ddc205bde555 req-d52f016a-b306-40f3-8890-a4d51cade202 service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fd276c3e-2ee5-4bd7-92ae-ddc205bde555 req-d52f016a-b306-40f3-8890-a4d51cade202 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fd276c3e-2ee5-4bd7-92ae-ddc205bde555 req-d52f016a-b306-40f3-8890-a4d51cade202 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-fd276c3e-2ee5-4bd7-92ae-ddc205bde555 req-d52f016a-b306-40f3-8890-a4d51cade202 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:06:59 user nova-compute[75235]: WARNING nova.compute.manager [req-fd276c3e-2ee5-4bd7-92ae-ddc205bde555 req-d52f016a-b306-40f3-8890-a4d51cade202 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:06:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== connect_volume: return (2598ms) {'type': 'block', 'scsi_wwn': '26566623837633631', 'path': '/dev/sdf'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566623837633631', 'path': '/dev/sdf'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updated VIF entry in instance network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'flavor' on Instance uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-94d25576-7274-4b2f-b47d-1ec54e451211 req-785b2a1a-ea16-4e39-b25a-babdf72146dd service nova] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:06:59 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:06:59 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:06:59 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:06:59 user nova-compute[75235]:   <serial>0fd14c51-11de-4f1c-b312-f13d97fbd3d1</serial>
Nov 29 19:06:59 user nova-compute[75235]: </disk>
Nov 29 19:06:59 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:06:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance destroyed successfully.
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1bd8bb9-55ce-469a-9f03-12b2fed19f9e req-b51f2b8e-8c88-40be-b727-1df27ba05169 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1bd8bb9-55ce-469a-9f03-12b2fed19f9e req-b51f2b8e-8c88-40be-b727-1df27ba05169 service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1bd8bb9-55ce-469a-9f03-12b2fed19f9e req-b51f2b8e-8c88-40be-b727-1df27ba05169 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e1bd8bb9-55ce-469a-9f03-12b2fed19f9e req-b51f2b8e-8c88-40be-b727-1df27ba05169 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-e1bd8bb9-55ce-469a-9f03-12b2fed19f9e req-b51f2b8e-8c88-40be-b727-1df27ba05169 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:00 user nova-compute[75235]: WARNING nova.compute.manager [req-e1bd8bb9-55ce-469a-9f03-12b2fed19f9e req-b51f2b8e-8c88-40be-b727-1df27ba05169 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state building and task_state spawning.
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No VIF found with MAC fa:16:3e:cd:47:86, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing instance network info cache due to event network-changed-e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Refreshing network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4b5094fc-f3dc-4508-b013-0074477601d3 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.231s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-5c7a98af-5bdc-4352-86e6-c2904af77693 req-15bddf3c-d8a0-4e30-937c-da9cca84edda service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5c7a98af-5bdc-4352-86e6-c2904af77693 req-15bddf3c-d8a0-4e30-937c-da9cca84edda service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5c7a98af-5bdc-4352-86e6-c2904af77693 req-15bddf3c-d8a0-4e30-937c-da9cca84edda service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5c7a98af-5bdc-4352-86e6-c2904af77693 req-15bddf3c-d8a0-4e30-937c-da9cca84edda service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-5c7a98af-5bdc-4352-86e6-c2904af77693 req-15bddf3c-d8a0-4e30-937c-da9cca84edda service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:01 user nova-compute[75235]: WARNING nova.compute.manager [req-5c7a98af-5bdc-4352-86e6-c2904af77693 req-15bddf3c-d8a0-4e30-937c-da9cca84edda service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:07:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updated VIF entry in instance network info cache for port e3569ef3-c352-424a-8e4a-2be65c7de3a5. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-143bf262-226a-4ce6-b5b0-0372a2b21e45 req-dd8e6201-9b7e-455c-bdf3-7877086b06ff service nova] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-468d6955-b94f-4596-b366-c6cf1188e0f2 req-bc01f932-9253-4678-8602-0068e119e9f6 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-468d6955-b94f-4596-b366-c6cf1188e0f2 req-bc01f932-9253-4678-8602-0068e119e9f6 service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-468d6955-b94f-4596-b366-c6cf1188e0f2 req-bc01f932-9253-4678-8602-0068e119e9f6 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-468d6955-b94f-4596-b366-c6cf1188e0f2 req-bc01f932-9253-4678-8602-0068e119e9f6 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-468d6955-b94f-4596-b366-c6cf1188e0f2 req-bc01f932-9253-4678-8602-0068e119e9f6 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:02 user nova-compute[75235]: WARNING nova.compute.manager [req-468d6955-b94f-4596-b366-c6cf1188e0f2 req-bc01f932-9253-4678-8602-0068e119e9f6 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state building and task_state spawning.
Nov 29 19:07:02 user nova-compute[75235]: INFO nova.compute.manager [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Rebuilding instance
Nov 29 19:07:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:03 user nova-compute[75235]: WARNING nova.compute.manager [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:07:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:03 user nova-compute[75235]: WARNING nova.compute.manager [req-8c0d956e-fe50-4697-8847-d783234c868d req-971135ce-8a92-42b3-80bf-b4b823c20127 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance destroyed successfully.
Nov 29 19:07:03 user nova-compute[75235]: INFO nova.compute.manager [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Detaching volume 0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:07:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:04 user nova-compute[75235]: INFO nova.virt.block_device [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attempting to driver detach volume 0fd14c51-11de-4f1c-b312-f13d97fbd3d1 from mountpoint /dev/vdb
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Attempting to detach device vdb from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:07:04 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:07:04 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:07:04 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:07:04 user nova-compute[75235]:   <serial>0fd14c51-11de-4f1c-b312-f13d97fbd3d1</serial>
Nov 29 19:07:04 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:07:04 user nova-compute[75235]: </disk>
Nov 29 19:07:04 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:07:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully detached device vdb from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 from the persistent domain config.
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55bd4d-8fa8-46fb-9a6d-2ddbd2421d8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:07:04 user nova-compute[75235]: No targets found.
Nov 29 19:07:04 user nova-compute[75235]: iSNS:
Nov 29 19:07:04 user nova-compute[75235]: No targets found.
Nov 29 19:07:04 user nova-compute[75235]: STATIC:
Nov 29 19:07:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:07:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:07:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3
Nov 29 19:07:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:07:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:07:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:04 user nova-compute[75235]: FIRMWARE:
Nov 29 19:07:04 user nova-compute[75235]: No targets found.
Nov 29 19:07:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:07:04 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:07:04 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38bdd8-6cba-43a1-83ee-a2abb88af014]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[08818f1a-846d-4f14-ac47-75e470d0c28b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:04 user nova-compute[75235]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c72a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1'): ({'sdf'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Removing single pathed devices sdf {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f0ac8-ff6b-4c84-acd8-edfd4219b3ab]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb15289-f73b-408b-a94c-8c096ef2e761]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flushing IO for device /dev/sdf {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede51c26-e54c-4af5-8188-2a7589b9e6b9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[572fc385-0536-4b78-b23e-9264e2df9e98]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ee7144-4f19-4bbe-b05b-fbded401ffb0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:07:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance spawned successfully.
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[14823106-5e0b-4eab-a7ae-8ce918b94af6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]
Nov 29 19:07:04 user nova-compute[75235]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4155e0-5837-4aa6-b502-7ebdd1689045]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== disconnect_volume: return (360ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:07:04 user nova-compute[75235]: INFO nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:04 user nova-compute[75235]: WARNING nova.compute.manager [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state active and task_state rebuilding.
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:04 user nova-compute[75235]: WARNING nova.compute.manager [req-780856af-36de-486a-8bf9-cb758209ea42 req-ba9a1753-7a64-459f-a0c5-60cc8ebab8bf service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state active and task_state rebuilding.
Nov 29 19:07:04 user nova-compute[75235]: INFO nova.compute.manager [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Took 18.23 seconds to build instance.
Nov 29 19:07:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a99b053d-bb40-4241-aae2-e6cf08ac49f9 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.338s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdf4b79c-bb90-4848-adb9-01532671367f tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance destroyed successfully.
Nov 29 19:07:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-452764783',display_name='tempest-ServerActionsTestOtherA-server-2138617368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-452764783',id=15,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhlCj/4Wb1/znNidthF7GTl7ZFQnQRIHHkVL4+OP2nWB9AGzxFnIF1SOQbUUzDG+crOoTUDPSmrLhE0Rk3obbMmRv6oSwbsUt4imU4nZnxpr11Me+oK5jggNMnTB7aikA==',key_name='tempest-keypair-1677183937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-qxoxu2ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=0e7eb484-033e-4a7a-a259-a183e78a6b96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8907cc3-5f, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a460632-b6a5-4f9e-a499-aa1fc3b428a0) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:05 user nova-compute[75235]: INFO os_vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f')
Nov 29 19:07:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[86279bdf-3ef0-42e5-82cc-76505c744ab9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:07:05 user nova-compute[75235]: No targets found.
Nov 29 19:07:05 user nova-compute[75235]: iSNS:
Nov 29 19:07:05 user nova-compute[75235]: No targets found.
Nov 29 19:07:05 user nova-compute[75235]: STATIC:
Nov 29 19:07:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:07:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:07:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3
Nov 29 19:07:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:07:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:05 user nova-compute[75235]: FIRMWARE:
Nov 29 19:07:05 user nova-compute[75235]: No targets found.
Nov 29 19:07:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:07:05 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:07:05 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34ca363-5c39-4b5d-93b6-c000fae7ae93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ea29c0-d171-41ac-877f-201a51ed728d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:05 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:07:05 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:05 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:05 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:07:05 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:05 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56505170a0>, {}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Disconnecting from: [] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== disconnect_volume: return (92ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:07:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Deleting instance files /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96_del
Nov 29 19:07:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Deletion of /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96_del complete
Nov 29 19:07:05 user nova-compute[75235]: INFO nova.virt.block_device [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Booting with volume 0fd14c51-11de-4f1c-b312-f13d97fbd3d1 at /dev/vdb
Nov 29 19:07:05 user nova-compute[75235]: DEBUG os_brick.utils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f840b45-1347-40cc-9c54-6faf6ad56b9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77f50c-856b-4363-818d-befbe377343a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489a388-9ef1-43e5-bf47-fdb243558820]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afbff9-0b37-4ccf-97a8-8eafd2161767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:06 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f444b-c58f-4fa7-bb00-21f363b0f24c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.utils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating existing volume attachment record: 629566bd-5f11-4d27-a818-7a94025027f9 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:07:06 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 is timed out.
Nov 29 19:07:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully detached device vdc from instance eafeb96d-7762-4d67-b3ff-e1221296ecb5 from the live domain config.
Nov 29 19:07:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtlJhVUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:06 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d486e-6578-46a0-9db4-d0c4978898df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:07:06 user nova-compute[75235]: No targets found.
Nov 29 19:07:06 user nova-compute[75235]: iSNS:
Nov 29 19:07:06 user nova-compute[75235]: No targets found.
Nov 29 19:07:06 user nova-compute[75235]: STATIC:
Nov 29 19:07:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:07:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:07:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3
Nov 29 19:07:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:06 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:07:06 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:06 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:06 user nova-compute[75235]: FIRMWARE:
Nov 29 19:07:06 user nova-compute[75235]: No targets found.
Nov 29 19:07:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:07:06 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:07:06 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc099489-e0eb-4f69-8605-fcd773adb554]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b2c6af-aa95-41ef-b5d5-1b1a4062f148]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:06 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:07:06 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:06 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:06 user nova-compute[75235]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 (non-flash)
Nov 29 19:07:06 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:06 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5650517490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7936278-b16f-4a10-927c-bb58e2e6f2f7]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b5b49-4725-41dd-a99f-16dccd65a2fc]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57c9589-e877-4b1b-b95e-311101d387b5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73f1e4a-21a8-4512-bcb9-9d1be2e8fd76]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a0a78-3a86-40c4-88b1-e3999fb21540]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd7044b-4020-4a97-ba58-f04855174961]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260]
Nov 29 19:07:06 user nova-compute[75235]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c6b30c1-aadb-444b-b17e-1c01b3e269a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2508bc-39e2-44eb-8acf-c53010fdd2ca]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] <== disconnect_volume: return (368ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing instance network info cache due to event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'flavor' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ce419af4-752f-41cb-9163-079895570662 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updated VIF entry in instance network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG nova.network.neutron [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95eaa80c-08bd-4c23-a45b-37c8e23022d7 req-a0bc4cb6-df86-418b-93f5-3ed18325ad64 service nova] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:08 user nova-compute[75235]: INFO nova.compute.manager [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Shelve offloading
Nov 29 19:07:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-8d89d4c2-a2f1-4c96-a1bb-bac3846aa6e7 req-ba1982c0-9105-4396-8d4d-b693a42eb685 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-unplugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8d89d4c2-a2f1-4c96-a1bb-bac3846aa6e7 req-ba1982c0-9105-4396-8d4d-b693a42eb685 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8d89d4c2-a2f1-4c96-a1bb-bac3846aa6e7 req-ba1982c0-9105-4396-8d4d-b693a42eb685 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8d89d4c2-a2f1-4c96-a1bb-bac3846aa6e7 req-ba1982c0-9105-4396-8d4d-b693a42eb685 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-8d89d4c2-a2f1-4c96-a1bb-bac3846aa6e7 req-ba1982c0-9105-4396-8d4d-b693a42eb685 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-unplugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:08 user nova-compute[75235]: WARNING nova.compute.manager [req-8d89d4c2-a2f1-4c96-a1bb-bac3846aa6e7 req-ba1982c0-9105-4396-8d4d-b693a42eb685 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-unplugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state active and task_state shelving.
Nov 29 19:07:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance destroyed successfully.
Nov 29 19:07:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:07:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:09 user nova-compute[75235]: WARNING nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid c1d8be89-d905-43dc-8d73-4632fa1e7227 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 8abc39f4-4d73-4a69-8acb-d87fe3871867 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 9d57cb98-5640-4104-ab59-fc0f4786433c {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid d55c8d69-fbcb-4513-89a3-cea3e902c3eb {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 68da4f22-a767-4f82-a0fa-e757d8437c1d {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:09 user nova-compute[75235]: INFO nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.165s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.175s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.197s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.217s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.224s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance destroyed successfully.
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'resources' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1990269533',display_name='tempest-TestShelveInstance-server-1990269533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1990269533',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwuUAHo0jwzkFo+G9dHO4IbcAK7m9iueW3B1/f+1+oHWzOZUFmBkAbv7BvCrr8wX9PC/8xS2nCbpF9Wc2xUJnaZgsZxXOax+xZM2D/QvcuO6cO44p7ccbkoW5BOcb1egA==',key_name='tempest-TestShelveInstance-1055985921',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb3eff325cd4b08bb2b3a3a1545433f',ramdisk_id='',reservation_id='r-s0b0nq41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1781237838',owner_user_name='tempest-TestShelveInstance-1781237838-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:05:32Z,user_data=None,user_id='d3da1a3f4fe44a6b8d177891669e67bc',uuid=03f7d056-56b5-45ba-a6e1-3449e35b9728,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converting VIF {"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_vif [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbdd8a68-f5, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdbd7ba9-ef65-462c-b61a-a0d11ace2db1) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:10 user nova-compute[75235]: INFO os_vif [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5')
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:10 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cd511b-d6a5-4307-a4dd-84addf68021b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:07:10 user nova-compute[75235]: No targets found.
Nov 29 19:07:10 user nova-compute[75235]: iSNS:
Nov 29 19:07:10 user nova-compute[75235]: No targets found.
Nov 29 19:07:10 user nova-compute[75235]: STATIC:
Nov 29 19:07:10 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:07:10 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:10 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:10 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:07:10 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:10 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:10 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:07:10 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:10 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:10 user nova-compute[75235]: FIRMWARE:
Nov 29 19:07:10 user nova-compute[75235]: No targets found.
Nov 29 19:07:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:07:10 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:07:10 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1586b2-03aa-4442-820e-dd01e33a03e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e60be-a291-4f70-ba02-59c6452bf771]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:10 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:10 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:10 user nova-compute[75235]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:07:10 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c779900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de2ef3b-e5de-412a-9c21-f2487d2a339f]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[df13ca28-71d1-4776-98e3-f4d985c954c7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[513291fb-1f6e-4dc1-95c4-0fc491ca2799]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:10 user nova-compute[75235]: WARNING nova.compute.manager [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state active and task_state shelving.
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing instance network info cache due to event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2acf937-e68e-4f7a-b6ed-a7cc40041cfa]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa552efa-d1c3-4a9e-910f-5163ba7e7091]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ae7e2-3cae-4389-8d29-8ccc5b1f7758]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]
Nov 29 19:07:10 user nova-compute[75235]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a982485-7b92-40a4-8581-24dc76d56cae]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] <== disconnect_volume: return (397ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:07:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Deleting instance files /opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728_del
Nov 29 19:07:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Deletion of /opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728_del complete
Nov 29 19:07:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updated VIF entry in instance network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:07:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": null, "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0d1d7fa8-f4dc-47be-b0d3-94ac94c35cdf req-57de8f8f-6a68-475d-85cb-35b510671e09 service nova] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:12 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Deleted allocations for instance 03f7d056-56b5-45ba-a6e1-3449e35b9728
Nov 29 19:07:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:12 user nova-compute[75235]: DEBUG nova.objects.instance [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'numa_topology' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:12 user nova-compute[75235]: DEBUG nova.objects.base [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Object Instance<03f7d056-56b5-45ba-a6e1-3449e35b9728> lazy-loaded attributes: resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:07:13 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:13 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-66949a43-f7ec-4b83-bc76-1d8f83c389d4 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.367s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.602s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:13 user nova-compute[75235]: INFO nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] During sync_power_state the instance has a pending task (shelving). Skip.
Nov 29 19:07:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:14 user nova-compute[75235]: INFO nova.compute.manager [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Terminating instance
Nov 29 19:07:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-4760b96f-0f29-4b05-8e5f-7ace78d6fb1a req-5eeadaf6-64e6-4ebf-837d-c98e09cf1582 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-vif-unplugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4760b96f-0f29-4b05-8e5f-7ace78d6fb1a req-5eeadaf6-64e6-4ebf-837d-c98e09cf1582 service nova] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4760b96f-0f29-4b05-8e5f-7ace78d6fb1a req-5eeadaf6-64e6-4ebf-837d-c98e09cf1582 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4760b96f-0f29-4b05-8e5f-7ace78d6fb1a req-5eeadaf6-64e6-4ebf-837d-c98e09cf1582 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-4760b96f-0f29-4b05-8e5f-7ace78d6fb1a req-5eeadaf6-64e6-4ebf-837d-c98e09cf1582 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] No waiting events found dispatching network-vif-unplugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-4760b96f-0f29-4b05-8e5f-7ace78d6fb1a req-5eeadaf6-64e6-4ebf-837d-c98e09cf1582 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-vif-unplugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:07:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Instance destroyed successfully.
Nov 29 19:07:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lazy-loading 'resources' on Instance uuid d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1644296104',display_name='tempest-VolumesAdminNegativeTest-server-1644296104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1644296104',id=6,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCO8g8+z+yWFbZ1RW/mxkXE19r6HX5CzQvcqt8ZRx9CULEgaIj409V77QwiLUkmVJSt6/OYwoSNkd2X00no2L6tCes4WM+JU97QfT4puDc8dyERiqX1xr8XCig4OQCSxA==',key_name='tempest-keypair-158564876',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbbea24130784a9fbd5a9572e30b3094',ramdisk_id='',reservation_id='r-lrw9gifa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1338291818',owner_user_name='tempest-VolumesAdminNegativeTest-1338291818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f516b841e854f1dbc8518c1e346fb0d',uuid=d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converting VIF {"id": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "address": "fa:16:3e:c1:e1:90", "network": {"id": "7c0994c4-26ce-40d1-8e4e-c5a1711c3436", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-995591632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbbea24130784a9fbd5a9572e30b3094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3bc0bbb-19", "ovs_interfaceid": "e3bc0bbb-19b7-481d-a207-158aa7d7fe78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG os_vif [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3bc0bbb-19, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91c95d4d-167a-4742-81b2-96aa7535097a) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:15 user nova-compute[75235]: INFO os_vif [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:e1:90,bridge_name='br-int',has_traffic_filtering=True,id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78,network=Network(7c0994c4-26ce-40d1-8e4e-c5a1711c3436),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3bc0bbb-19')
Nov 29 19:07:15 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Deleting instance files /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2_del
Nov 29 19:07:15 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Deletion of /opt/stack/data/nova/instances/d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2_del complete
Nov 29 19:07:15 user nova-compute[75235]: INFO nova.compute.manager [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 19:07:15 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:15 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Took 0.86 seconds to deallocate network for instance.
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-a79ac9bd-3c7f-41bb-9c7b-e333b249c567 req-2a899f24-f131-4907-a391-eb3477481a2c service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-vif-deleted-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:15 user nova-compute[75235]: INFO nova.compute.manager [req-a79ac9bd-3c7f-41bb-9c7b-e333b249c567 req-2a899f24-f131-4907-a391-eb3477481a2c service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Neutron deleted interface e3bc0bbb-19b7-481d-a207-158aa7d7fe78; detaching it from the instance and deleting it from the info cache
Nov 29 19:07:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-a79ac9bd-3c7f-41bb-9c7b-e333b249c567 req-2a899f24-f131-4907-a391-eb3477481a2c service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-a79ac9bd-3c7f-41bb-9c7b-e333b249c567 req-2a899f24-f131-4907-a391-eb3477481a2c service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Detach interface failed, port_id=e3bc0bbb-19b7-481d-a207-158aa7d7fe78, reason: Instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:07:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Creating image(s)
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.227s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-80652bc2-a1fd-438e-859c-8a66712ce44d req-82fe3449-e368-4ed2-958d-39eb261e3f73 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received event network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-80652bc2-a1fd-438e-859c-8a66712ce44d req-82fe3449-e368-4ed2-958d-39eb261e3f73 service nova] Acquiring lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-80652bc2-a1fd-438e-859c-8a66712ce44d req-82fe3449-e368-4ed2-958d-39eb261e3f73 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-80652bc2-a1fd-438e-859c-8a66712ce44d req-82fe3449-e368-4ed2-958d-39eb261e3f73 service nova] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-80652bc2-a1fd-438e-859c-8a66712ce44d req-82fe3449-e368-4ed2-958d-39eb261e3f73 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] No waiting events found dispatching network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:16 user nova-compute[75235]: WARNING nova.compute.manager [req-80652bc2-a1fd-438e-859c-8a66712ce44d req-82fe3449-e368-4ed2-958d-39eb261e3f73 service nova] [instance: d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2] Received unexpected event network-vif-plugged-e3bc0bbb-19b7-481d-a207-158aa7d7fe78 for instance with vm_state deleted and task_state None.
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.231s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:16 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Deleted allocations for instance d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk 1073741824" returned: 0 in 0.069s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:16 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:07:16 user nova-compute[75235]: INFO nova.compute.claims [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Claim successful on node user
Nov 29 19:07:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68ad5b1c-68e8-41f2-a3fa-4990b87b96a8 tempest-VolumesAdminNegativeTest-1338291818 tempest-VolumesAdminNegativeTest-1338291818-project-member] Lock "d588ebd6-a03d-4d2f-96d8-f1e6fd57e7b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.795s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.224s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Cannot resize image /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Ensure instance console log exists: /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Start _get_guest_xml network_info=[{"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '629566bd-5f11-4d27-a818-7a94025027f9', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e7eb484-033e-4a7a-a259-a183e78a6b96', 'attached_at': '', 'detached_at': '', 'volume_id': '0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'serial': '0fd14c51-11de-4f1c-b312-f13d97fbd3d1'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:07:17 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 19:07:17 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:17 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:17 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:17 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d14a1cb-03f8-4027-b69c-a31ece62077f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:07:17 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dbb8ec-b2f9-43a5-80bc-9ad172c24151]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1] added
Nov 29 19:07:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a93b6b-1777-47e8-8fe0-5e18f564de50]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7453785-abdb-46e7-b8da-03257666d8ec]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjRWmMJY {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjRWmMJY" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc658dc-f87f-4f08-be96-df8f7bfae319]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjRWmMJY'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[51508a15-f512-4c7e-86b6-ca79d17d79ee]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb1189-4c8e-4aa6-8ac8-7d6e31d2de1a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:17 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:17 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.policy [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e2babb226c484046aab50a159bf20ef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f675723ce844bf5ae965d0b53ae439d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e68c68-9abb-40c2-98a8-ea58c2859817]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]
Nov 29 19:07:17 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72af093a-d710-4e4e-9f08-6b2025f62877]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:07:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Creating image(s)
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "/opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "/opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c2316-36b2-4408-ad06-a21182b1c2c9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:17 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:17 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:17 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:17 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5845da0-a16d-4ce0-be6f-ec286b139c01]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk 1073741824" returned: 0 in 0.052s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Successfully created port: 2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.217s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Cannot resize image /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Ensure instance console log exists: /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26566623837633631', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566623837633631', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-452764783',display_name='tempest-ServerActionsTestOtherA-server-2138617368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-452764783',id=15,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhlCj/4Wb1/znNidthF7GTl7ZFQnQRIHHkVL4+OP2nWB9AGzxFnIF1SOQbUUzDG+crOoTUDPSmrLhE0Rk3obbMmRv6oSwbsUt4imU4nZnxpr11Me+oK5jggNMnTB7aikA==',key_name='tempest-keypair-1677183937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-qxoxu2ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=0e7eb484-033e-4a7a-a259-a183e78a6b96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:07:19 user nova-compute[75235]:   <uuid>0e7eb484-033e-4a7a-a259-a183e78a6b96</uuid>
Nov 29 19:07:19 user nova-compute[75235]:   <name>instance-0000000f</name>
Nov 29 19:07:19 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:07:19 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:07:19 user nova-compute[75235]:   <metadata>
Nov 29 19:07:19 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:07:19 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:07:19 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherA-server-2138617368</nova:name>
Nov 29 19:07:19 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:07:17</nova:creationTime>
Nov 29 19:07:19 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:07:19 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:07:19 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:07:19 user nova-compute[75235]:       <nova:owner>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:user uuid="1d98bb13233f447295cf54cb5b1574e8">tempest-ServerActionsTestOtherA-279549641-project-member</nova:user>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:project uuid="68dafa45545c46169abd1cad11ba15cc">tempest-ServerActionsTestOtherA-279549641</nova:project>
Nov 29 19:07:19 user nova-compute[75235]:       </nova:owner>
Nov 29 19:07:19 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:07:19 user nova-compute[75235]:       <nova:ports>
Nov 29 19:07:19 user nova-compute[75235]:         <nova:port uuid="f8907cc3-5fa0-46bf-860f-250eaa8181e8">
Nov 29 19:07:19 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 19:07:19 user nova-compute[75235]:         </nova:port>
Nov 29 19:07:19 user nova-compute[75235]:       </nova:ports>
Nov 29 19:07:19 user nova-compute[75235]:     </nova:instance>
Nov 29 19:07:19 user nova-compute[75235]:   </metadata>
Nov 29 19:07:19 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:07:19 user nova-compute[75235]:     <system>
Nov 29 19:07:19 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:07:19 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:07:19 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:07:19 user nova-compute[75235]:       <entry name="serial">0e7eb484-033e-4a7a-a259-a183e78a6b96</entry>
Nov 29 19:07:19 user nova-compute[75235]:       <entry name="uuid">0e7eb484-033e-4a7a-a259-a183e78a6b96</entry>
Nov 29 19:07:19 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:07:19 user nova-compute[75235]:     </system>
Nov 29 19:07:19 user nova-compute[75235]:   </sysinfo>
Nov 29 19:07:19 user nova-compute[75235]:   <os>
Nov 29 19:07:19 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:07:19 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:07:19 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:07:19 user nova-compute[75235]:   </os>
Nov 29 19:07:19 user nova-compute[75235]:   <features>
Nov 29 19:07:19 user nova-compute[75235]:     <acpi/>
Nov 29 19:07:19 user nova-compute[75235]:     <apic/>
Nov 29 19:07:19 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:07:19 user nova-compute[75235]:   </features>
Nov 29 19:07:19 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:07:19 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:07:19 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:07:19 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:07:19 user nova-compute[75235]:   </clock>
Nov 29 19:07:19 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:07:19 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:07:19 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:07:19 user nova-compute[75235]:   </cpu>
Nov 29 19:07:19 user nova-compute[75235]:   <devices>
Nov 29 19:07:19 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:07:19 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:07:19 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk"/>
Nov 29 19:07:19 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:07:19 user nova-compute[75235]:     </disk>
Nov 29 19:07:19 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:07:19 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:07:19 user nova-compute[75235]:       <source dev="/dev/sdc"/>
Nov 29 19:07:19 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:07:19 user nova-compute[75235]:       <serial>0fd14c51-11de-4f1c-b312-f13d97fbd3d1</serial>
Nov 29 19:07:19 user nova-compute[75235]:     </disk>
Nov 29 19:07:19 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:07:19 user nova-compute[75235]:       <mac address="fa:16:3e:cd:47:86"/>
Nov 29 19:07:19 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:07:19 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:07:19 user nova-compute[75235]:       <target dev="tapf8907cc3-5f"/>
Nov 29 19:07:19 user nova-compute[75235]:     </interface>
Nov 29 19:07:19 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:07:19 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/console.log" append="off"/>
Nov 29 19:07:19 user nova-compute[75235]:     </serial>
Nov 29 19:07:19 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:07:19 user nova-compute[75235]:     <video>
Nov 29 19:07:19 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:07:19 user nova-compute[75235]:     </video>
Nov 29 19:07:19 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:07:19 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:07:19 user nova-compute[75235]:     </rng>
Nov 29 19:07:19 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:07:19 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:07:19 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:07:19 user nova-compute[75235]:     </memballoon>
Nov 29 19:07:19 user nova-compute[75235]:   </devices>
Nov 29 19:07:19 user nova-compute[75235]: </domain>
Nov 29 19:07:19 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-452764783',display_name='tempest-ServerActionsTestOtherA-server-2138617368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-452764783',id=15,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhlCj/4Wb1/znNidthF7GTl7ZFQnQRIHHkVL4+OP2nWB9AGzxFnIF1SOQbUUzDG+crOoTUDPSmrLhE0Rk3obbMmRv6oSwbsUt4imU4nZnxpr11Me+oK5jggNMnTB7aikA==',key_name='tempest-keypair-1677183937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-qxoxu2ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=0e7eb484-033e-4a7a-a259-a183e78a6b96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG os_vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60b75606-3346-5dfd-a335-8b82cb7d603a', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8907cc3-5f, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8907cc3-5f, col_values=(('qos', UUID('aa66142c-3523-4987-9f65-69028de0e1b5')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8907cc3-5f, col_values=(('external_ids', {'iface-id': 'f8907cc3-5fa0-46bf-860f-250eaa8181e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:47:86', 'vm-uuid': '0e7eb484-033e-4a7a-a259-a183e78a6b96'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:19 user nova-compute[75235]: INFO os_vif [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f')
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No VIF found with MAC fa:16:3e:cd:47:86, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Successfully updated port: 2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquired lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-changed-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Refreshing instance network info cache due to event network-changed-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] Acquiring lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updating instance_info_cache with network_info: [{"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Releasing lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Instance network_info: |[{"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] Acquired lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Refreshing network info cache for port 2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Start _get_guest_xml network_info=[{"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:07:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:07:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-279975914',display_name='tempest-AttachVolumeTestJSON-server-279975914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-279975914',id=22,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ065TwqxfC4oe23Nw55p8M6VcZtMZbG/UQXIMpvkDOhy7Zljp4CT0bRjn2hsysqVxnqUR6tMtY5McNOZEswqdjXwqljtmQfoe4aHvWY0Emel/w0Ph9/K8qZ331aM3CRQ==',key_name='tempest-keypair-1496592804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f675723ce844bf5ae965d0b53ae439d',ramdisk_id='',reservation_id='r-qwpx80ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430085223',owner_user_name='tempest-AttachVolumeTestJSON-1430085223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2babb226c484046aab50a159bf20ef4',uuid=fd04b533-21ff-408c-9571-2a873100743e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converting VIF {"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'pci_devices' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:07:20 user nova-compute[75235]:   <uuid>fd04b533-21ff-408c-9571-2a873100743e</uuid>
Nov 29 19:07:20 user nova-compute[75235]:   <name>instance-00000016</name>
Nov 29 19:07:20 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:07:20 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:07:20 user nova-compute[75235]:   <metadata>
Nov 29 19:07:20 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:07:20 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:07:20 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeTestJSON-server-279975914</nova:name>
Nov 29 19:07:20 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:07:19</nova:creationTime>
Nov 29 19:07:20 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:07:20 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:07:20 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:07:20 user nova-compute[75235]:       <nova:owner>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:user uuid="e2babb226c484046aab50a159bf20ef4">tempest-AttachVolumeTestJSON-1430085223-project-member</nova:user>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:project uuid="9f675723ce844bf5ae965d0b53ae439d">tempest-AttachVolumeTestJSON-1430085223</nova:project>
Nov 29 19:07:20 user nova-compute[75235]:       </nova:owner>
Nov 29 19:07:20 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:07:20 user nova-compute[75235]:       <nova:ports>
Nov 29 19:07:20 user nova-compute[75235]:         <nova:port uuid="2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8">
Nov 29 19:07:20 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 19:07:20 user nova-compute[75235]:         </nova:port>
Nov 29 19:07:20 user nova-compute[75235]:       </nova:ports>
Nov 29 19:07:20 user nova-compute[75235]:     </nova:instance>
Nov 29 19:07:20 user nova-compute[75235]:   </metadata>
Nov 29 19:07:20 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:07:20 user nova-compute[75235]:     <system>
Nov 29 19:07:20 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:07:20 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:07:20 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:07:20 user nova-compute[75235]:       <entry name="serial">fd04b533-21ff-408c-9571-2a873100743e</entry>
Nov 29 19:07:20 user nova-compute[75235]:       <entry name="uuid">fd04b533-21ff-408c-9571-2a873100743e</entry>
Nov 29 19:07:20 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:07:20 user nova-compute[75235]:     </system>
Nov 29 19:07:20 user nova-compute[75235]:   </sysinfo>
Nov 29 19:07:20 user nova-compute[75235]:   <os>
Nov 29 19:07:20 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:07:20 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:07:20 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:07:20 user nova-compute[75235]:   </os>
Nov 29 19:07:20 user nova-compute[75235]:   <features>
Nov 29 19:07:20 user nova-compute[75235]:     <acpi/>
Nov 29 19:07:20 user nova-compute[75235]:     <apic/>
Nov 29 19:07:20 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:07:20 user nova-compute[75235]:   </features>
Nov 29 19:07:20 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:07:20 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:07:20 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:07:20 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:07:20 user nova-compute[75235]:   </clock>
Nov 29 19:07:20 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:07:20 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:07:20 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:07:20 user nova-compute[75235]:   </cpu>
Nov 29 19:07:20 user nova-compute[75235]:   <devices>
Nov 29 19:07:20 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:07:20 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:07:20 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk"/>
Nov 29 19:07:20 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:07:20 user nova-compute[75235]:     </disk>
Nov 29 19:07:20 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:07:20 user nova-compute[75235]:       <mac address="fa:16:3e:20:8c:8f"/>
Nov 29 19:07:20 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:07:20 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:07:20 user nova-compute[75235]:       <target dev="tap2c2ae742-6f"/>
Nov 29 19:07:20 user nova-compute[75235]:     </interface>
Nov 29 19:07:20 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:07:20 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/console.log" append="off"/>
Nov 29 19:07:20 user nova-compute[75235]:     </serial>
Nov 29 19:07:20 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:07:20 user nova-compute[75235]:     <video>
Nov 29 19:07:20 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:07:20 user nova-compute[75235]:     </video>
Nov 29 19:07:20 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:07:20 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:07:20 user nova-compute[75235]:     </rng>
Nov 29 19:07:20 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:07:20 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:07:20 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:07:20 user nova-compute[75235]:     </memballoon>
Nov 29 19:07:20 user nova-compute[75235]:   </devices>
Nov 29 19:07:20 user nova-compute[75235]: </domain>
Nov 29 19:07:20 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-279975914',display_name='tempest-AttachVolumeTestJSON-server-279975914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-279975914',id=22,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ065TwqxfC4oe23Nw55p8M6VcZtMZbG/UQXIMpvkDOhy7Zljp4CT0bRjn2hsysqVxnqUR6tMtY5McNOZEswqdjXwqljtmQfoe4aHvWY0Emel/w0Ph9/K8qZ331aM3CRQ==',key_name='tempest-keypair-1496592804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f675723ce844bf5ae965d0b53ae439d',ramdisk_id='',reservation_id='r-qwpx80ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1430085223',owner_user_name='tempest-AttachVolumeTestJSON-1430085223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2babb226c484046aab50a159bf20ef4',uuid=fd04b533-21ff-408c-9571-2a873100743e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converting VIF {"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG os_vif [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10407379-d561-5b13-aaaa-5c7dfc24e017', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c2ae742-6f, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c2ae742-6f, col_values=(('qos', UUID('b55c49b6-0617-407f-ac10-6f12706ec40d')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c2ae742-6f, col_values=(('external_ids', {'iface-id': '2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:8c:8f', 'vm-uuid': 'fd04b533-21ff-408c-9571-2a873100743e'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:20 user nova-compute[75235]: INFO os_vif [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f')
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No VIF found with MAC fa:16:3e:20:8c:8f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.network.neutron [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updated VIF entry in instance network info cache for port 2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG nova.network.neutron [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updating instance_info_cache with network_info: [{"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-adc6932a-fdef-49b2-abe3-40e69a8632fe req-892d7030-1bc9-43c5-96b9-afcfcc2091d4 service nova] Releasing lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:07:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance spawned successfully.
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:07:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: fd04b533-21ff-408c-9571-2a873100743e] Instance spawned successfully.
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75235) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 19:07:24 user nova-compute[75235]: INFO nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-36e9fd6a-b61f-4fbc-9b2c-720d2ae00d82 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:24 user nova-compute[75235]: INFO nova.compute.manager [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Took 8.09 seconds to build instance.
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b4420134-3a19-420d-a3ef-c8317063aee4 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.234s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:07:24 user nova-compute[75235]: INFO nova.compute.claims [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Claim successful on node user
Nov 29 19:07:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:07:25 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.policy [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f245202e6044bcdb5ce590c3d106bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daa1f254776450186b9239a565ecd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:07:25 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Creating image(s)
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "/opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "/opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.193s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.197s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk 1073741824" returned: 0 in 0.058s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-41b948eb-da71-4721-81bd-9477b323dab7 req-8cf78b1b-71fd-447b-8bc6-c4fbeee0ca5d service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41b948eb-da71-4721-81bd-9477b323dab7 req-8cf78b1b-71fd-447b-8bc6-c4fbeee0ca5d service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41b948eb-da71-4721-81bd-9477b323dab7 req-8cf78b1b-71fd-447b-8bc6-c4fbeee0ca5d service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41b948eb-da71-4721-81bd-9477b323dab7 req-8cf78b1b-71fd-447b-8bc6-c4fbeee0ca5d service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-41b948eb-da71-4721-81bd-9477b323dab7 req-8cf78b1b-71fd-447b-8bc6-c4fbeee0ca5d service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:26 user nova-compute[75235]: WARNING nova.compute.manager [req-41b948eb-da71-4721-81bd-9477b323dab7 req-8cf78b1b-71fd-447b-8bc6-c4fbeee0ca5d service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state active and task_state None.
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Cannot resize image /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Ensure instance console log exists: /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:26 user nova-compute[75235]: DEBUG nova.network.neutron [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Successfully created port: e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.neutron [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Successfully updated port: e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "refresh_cache-a9079b5c-d793-44b8-b8ef-c326b5082018" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquired lock "refresh_cache-a9079b5c-d793-44b8-b8ef-c326b5082018" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.neutron [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-changed-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Refreshing instance network info cache due to event network-changed-e3c1dd41-db96-42b6-8f62-a0e68d321399. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] Acquiring lock "refresh_cache-a9079b5c-d793-44b8-b8ef-c326b5082018" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.neutron [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.neutron [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Updating instance_info_cache with network_info: [{"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Releasing lock "refresh_cache-a9079b5c-d793-44b8-b8ef-c326b5082018" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Instance network_info: |[{"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] Acquired lock "refresh_cache-a9079b5c-d793-44b8-b8ef-c326b5082018" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.neutron [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Refreshing network info cache for port e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Start _get_guest_xml network_info=[{"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:07:27 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:07:27 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1633247778',display_name='tempest-VolumesActionsTest-instance-1633247778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1633247778',id=23,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8daa1f254776450186b9239a565ecd30',ramdisk_id='',reservation_id='r-452y5m54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-426343452',owner_user_name='tempest-VolumesActionsTest-426343452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:25Z,user_data=None,user_id='0f245202e6044bcdb5ce590c3d106bb2',uuid=a9079b5c-d793-44b8-b8ef-c326b5082018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converting VIF {"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lazy-loading 'pci_devices' on Instance uuid a9079b5c-d793-44b8-b8ef-c326b5082018 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:07:27 user nova-compute[75235]:   <uuid>a9079b5c-d793-44b8-b8ef-c326b5082018</uuid>
Nov 29 19:07:27 user nova-compute[75235]:   <name>instance-00000017</name>
Nov 29 19:07:27 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:07:27 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:07:27 user nova-compute[75235]:   <metadata>
Nov 29 19:07:27 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:07:27 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:07:27 user nova-compute[75235]:       <nova:name>tempest-VolumesActionsTest-instance-1633247778</nova:name>
Nov 29 19:07:27 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:07:27</nova:creationTime>
Nov 29 19:07:27 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:07:27 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:07:27 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:07:27 user nova-compute[75235]:       <nova:owner>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:user uuid="0f245202e6044bcdb5ce590c3d106bb2">tempest-VolumesActionsTest-426343452-project-member</nova:user>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:project uuid="8daa1f254776450186b9239a565ecd30">tempest-VolumesActionsTest-426343452</nova:project>
Nov 29 19:07:27 user nova-compute[75235]:       </nova:owner>
Nov 29 19:07:27 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:07:27 user nova-compute[75235]:       <nova:ports>
Nov 29 19:07:27 user nova-compute[75235]:         <nova:port uuid="e3c1dd41-db96-42b6-8f62-a0e68d321399">
Nov 29 19:07:27 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:07:27 user nova-compute[75235]:         </nova:port>
Nov 29 19:07:27 user nova-compute[75235]:       </nova:ports>
Nov 29 19:07:27 user nova-compute[75235]:     </nova:instance>
Nov 29 19:07:27 user nova-compute[75235]:   </metadata>
Nov 29 19:07:27 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:07:27 user nova-compute[75235]:     <system>
Nov 29 19:07:27 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:07:27 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:07:27 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:07:27 user nova-compute[75235]:       <entry name="serial">a9079b5c-d793-44b8-b8ef-c326b5082018</entry>
Nov 29 19:07:27 user nova-compute[75235]:       <entry name="uuid">a9079b5c-d793-44b8-b8ef-c326b5082018</entry>
Nov 29 19:07:27 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:07:27 user nova-compute[75235]:     </system>
Nov 29 19:07:27 user nova-compute[75235]:   </sysinfo>
Nov 29 19:07:27 user nova-compute[75235]:   <os>
Nov 29 19:07:27 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:07:27 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:07:27 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:07:27 user nova-compute[75235]:   </os>
Nov 29 19:07:27 user nova-compute[75235]:   <features>
Nov 29 19:07:27 user nova-compute[75235]:     <acpi/>
Nov 29 19:07:27 user nova-compute[75235]:     <apic/>
Nov 29 19:07:27 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:07:27 user nova-compute[75235]:   </features>
Nov 29 19:07:27 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:07:27 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:07:27 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:07:27 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:07:27 user nova-compute[75235]:   </clock>
Nov 29 19:07:27 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:07:27 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:07:27 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:07:27 user nova-compute[75235]:   </cpu>
Nov 29 19:07:27 user nova-compute[75235]:   <devices>
Nov 29 19:07:27 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:07:27 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:07:27 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk"/>
Nov 29 19:07:27 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:07:27 user nova-compute[75235]:     </disk>
Nov 29 19:07:27 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:07:27 user nova-compute[75235]:       <mac address="fa:16:3e:db:00:8b"/>
Nov 29 19:07:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:07:27 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:07:27 user nova-compute[75235]:       <target dev="tape3c1dd41-db"/>
Nov 29 19:07:27 user nova-compute[75235]:     </interface>
Nov 29 19:07:27 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:07:27 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/console.log" append="off"/>
Nov 29 19:07:27 user nova-compute[75235]:     </serial>
Nov 29 19:07:27 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:07:27 user nova-compute[75235]:     <video>
Nov 29 19:07:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:07:27 user nova-compute[75235]:     </video>
Nov 29 19:07:27 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:07:27 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:07:27 user nova-compute[75235]:     </rng>
Nov 29 19:07:27 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:07:27 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:07:27 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:07:27 user nova-compute[75235]:     </memballoon>
Nov 29 19:07:27 user nova-compute[75235]:   </devices>
Nov 29 19:07:27 user nova-compute[75235]: </domain>
Nov 29 19:07:27 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1633247778',display_name='tempest-VolumesActionsTest-instance-1633247778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1633247778',id=23,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8daa1f254776450186b9239a565ecd30',ramdisk_id='',reservation_id='r-452y5m54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-426343452',owner_user_name='tempest-VolumesActionsTest-426343452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:07:25Z,user_data=None,user_id='0f245202e6044bcdb5ce590c3d106bb2',uuid=a9079b5c-d793-44b8-b8ef-c326b5082018,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converting VIF {"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG os_vif [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0af9a84-28af-548e-a0e4-2ebe171d243f', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3c1dd41-db, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3c1dd41-db, col_values=(('qos', UUID('8e8c7ebf-c93f-4d73-9025-47fd3ac647f3')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3c1dd41-db, col_values=(('external_ids', {'iface-id': 'e3c1dd41-db96-42b6-8f62-a0e68d321399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:00:8b', 'vm-uuid': 'a9079b5c-d793-44b8-b8ef-c326b5082018'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:27 user nova-compute[75235]: INFO os_vif [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db')
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] No VIF found with MAC fa:16:3e:db:00:8b, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:28 user nova-compute[75235]: WARNING nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state active and task_state None.
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] No waiting events found dispatching network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:28 user nova-compute[75235]: WARNING nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received unexpected event network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 for instance with vm_state active and task_state None.
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] No waiting events found dispatching network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:28 user nova-compute[75235]: WARNING nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received unexpected event network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 for instance with vm_state active and task_state None.
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-changed-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Refreshing instance network info cache due to event network-changed-5669e733-8a19-4c66-8b64-0c538a0d3674. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Acquiring lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Acquired lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Refreshing network info cache for port 5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Updated VIF entry in instance network info cache for port e3c1dd41-db96-42b6-8f62-a0e68d321399. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Updating instance_info_cache with network_info: [{"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f067a18a-d532-4400-9412-6499fcc684ce req-6bab8e0e-ec66-4255-90f9-eccf7ae56db8 service nova] Releasing lock "refresh_cache-a9079b5c-d793-44b8-b8ef-c326b5082018" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lazy-loading 'flavor' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:28 user nova-compute[75235]: INFO nova.compute.manager [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Attaching volume 1f906b85-9b68-4aab-b077-ba39ac8d29f9 to /dev/vdb
Nov 29 19:07:28 user nova-compute[75235]: DEBUG os_brick.utils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3845955f-30c3-4b0a-b192-af0a2f3ea7c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updated VIF entry in instance network info cache for port 5669e733-8a19-4c66-8b64-0c538a0d3674. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.network.neutron [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updating instance_info_cache with network_info: [{"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae30d5-5023-415a-a17f-e1247ee92386]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7cbfca55-65c9-4008-8e91-7d74b8b8a2a0 req-9d559b5f-796e-4b7d-b5d4-4eb87e2283d0 service nova] Releasing lock "refresh_cache-cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[031e2d18-b39d-454c-a04f-5291dc04e676]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b0c18d-1247-442f-b472-814cbd83910e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:28 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:07:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6690ec-37ad-456f-87fc-4592cbf152f9]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG os_brick.utils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:28 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updating existing volume attachment record: 6d491d4c-ca06-4511-962a-0fe8e89be523 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:07:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] No waiting events found dispatching network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:30 user nova-compute[75235]: WARNING nova.compute.manager [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received unexpected event network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 for instance with vm_state building and task_state spawning.
Nov 29 19:07:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] No waiting events found dispatching network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:30 user nova-compute[75235]: WARNING nova.compute.manager [req-41356810-349b-41d7-894e-699d44f03c12 req-18b5cb81-3374-4f14-8890-2c225731cc8b service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received unexpected event network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 for instance with vm_state building and task_state spawning.
Nov 29 19:07:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:07:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:07:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Instance spawned successfully.
Nov 29 19:07:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:07:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:07:32 user nova-compute[75235]: INFO nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 29 19:07:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:32 user nova-compute[75235]: INFO nova.compute.manager [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Took 7.38 seconds to build instance.
Nov 29 19:07:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-004ced02-aea6-4b43-b216-b2d7008dd399 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:33 user nova-compute[75235]: INFO nova.compute.manager [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Detaching volume c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:07:33 user nova-compute[75235]: INFO nova.virt.block_device [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Attempting to driver detach volume c768b3db-abf8-4ab8-b2d4-06a521245d65 from mountpoint /dev/vdb
Nov 29 19:07:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Attempting to detach device vdb from instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:07:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:07:33 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:07:33 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:07:33 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:07:33 user nova-compute[75235]:   <serial>c768b3db-abf8-4ab8-b2d4-06a521245d65</serial>
Nov 29 19:07:33 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:07:33 user nova-compute[75235]: </disk>
Nov 29 19:07:33 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:07:33 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Successfully detached device vdb from instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 from the persistent domain config.
Nov 29 19:07:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:07:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:07:33 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:07:33 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:07:33 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:07:33 user nova-compute[75235]:   <serial>c768b3db-abf8-4ab8-b2d4-06a521245d65</serial>
Nov 29 19:07:33 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:07:33 user nova-compute[75235]: </disk>
Nov 29 19:07:33 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:07:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:07:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:35 user nova-compute[75235]: INFO nova.compute.manager [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Terminating instance
Nov 29 19:07:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-e6e0d1d4-24de-44e2-854f-f8bc03d099ec req-0dfe222d-c49d-4717-b195-c5b371fb56db service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e6e0d1d4-24de-44e2-854f-f8bc03d099ec req-0dfe222d-c49d-4717-b195-c5b371fb56db service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e6e0d1d4-24de-44e2-854f-f8bc03d099ec req-0dfe222d-c49d-4717-b195-c5b371fb56db service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e6e0d1d4-24de-44e2-854f-f8bc03d099ec req-0dfe222d-c49d-4717-b195-c5b371fb56db service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-e6e0d1d4-24de-44e2-854f-f8bc03d099ec req-0dfe222d-c49d-4717-b195-c5b371fb56db service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-e6e0d1d4-24de-44e2-854f-f8bc03d099ec req-0dfe222d-c49d-4717-b195-c5b371fb56db service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Instance destroyed successfully.
Nov 29 19:07:36 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'resources' on Instance uuid eafeb96d-7762-4d67-b3ff-e1221296ecb5 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1165392797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1165392797',id=3,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEII1tQquSsQcIVp/DbVQ39O0BcTO+EYsQFQm66AEFwNZL0nvH2fKVj0GY/eWa3Ziw3XMeigv16XYXD6yBlHC+b3T363mzu5UTvcexbwRIQkE+Uw1QKaYWWKiTeYDiqNiw==',key_name='tempest-keypair-1094556375',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-e0vwlvoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=eafeb96d-7762-4d67-b3ff-e1221296ecb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "62fcb2af-3273-4fdc-b68a-6c0492925844", "address": "fa:16:3e:1f:30:a0", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fcb2af-32", "ovs_interfaceid": "62fcb2af-3273-4fdc-b68a-6c0492925844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_vif [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62fcb2af-32, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d649d00b-8ccd-42ba-9e68-4adecce71654) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:37 user nova-compute[75235]: INFO os_vif [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:30:a0,bridge_name='br-int',has_traffic_filtering=True,id=62fcb2af-3273-4fdc-b68a-6c0492925844,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fcb2af-32')
Nov 29 19:07:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Deleting instance files /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5_del
Nov 29 19:07:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Deletion of /opt/stack/data/nova/instances/eafeb96d-7762-4d67-b3ff-e1221296ecb5_del complete
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: INFO nova.compute.manager [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:37 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:37 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:37 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f2b2c-01ac-4660-9a76-b0fe065a75c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:07:37 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01eaaf0-168e-478b-b0bb-141b4916f316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9] added
Nov 29 19:07:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9757912-5122-4f11-8748-59c1e6b5840d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27c6a6-7cef-4807-897a-456317d1599d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFzvgUsG {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFzvgUsG" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b09cc3-ad3f-430d-9f3d-1c82286c423c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFzvgUsG'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d09287-4d23-47d0-90d1-8a173fcc73ac]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea03c1-49f1-497e-aa54-03a0081ad9ba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0279b-1d83-4fa8-a7fd-7a05290dbf5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]
Nov 29 19:07:38 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ec3dc-621e-4823-965f-89b96233d6a4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3aa6a6-0667-4c04-8021-586b16d4ccce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fae276d-3d28-438a-98bc-1079e9b0a8cf]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:38 user nova-compute[75235]: WARNING nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state deleting.
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:38 user nova-compute[75235]: WARNING nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state deleting.
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:38 user nova-compute[75235]: WARNING nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state active and task_state deleting.
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bd3b35a-21a5-477a-99f9-d4f9eacccb25 req-e1d2b409-a031-473e-8f02-99f3ad6debd7 service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-unplugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:07:38 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:38 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Took 1.73 seconds to deallocate network for instance.
Nov 29 19:07:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23363396563353039', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363396563353039', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lazy-loading 'flavor' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:07:39 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:07:39 user nova-compute[75235]:   <source dev="/dev/sdd"/>
Nov 29 19:07:39 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:07:39 user nova-compute[75235]:   <serial>1f906b85-9b68-4aab-b077-ba39ac8d29f9</serial>
Nov 29 19:07:39 user nova-compute[75235]: </disk>
Nov 29 19:07:39 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:39 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Deleted allocations for instance eafeb96d-7762-4d67-b3ff-e1221296ecb5
Nov 29 19:07:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0ff25bd-9d9c-45d2-92cb-76254c17129f tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.629s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] No VIF found with MAC fa:16:3e:d7:4c:12, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:07:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bd88dc8d-dc3b-4c6f-9cee-e92111ef4aae tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.350s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] Acquiring lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] Lock "eafeb96d-7762-4d67-b3ff-e1221296ecb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] No waiting events found dispatching network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:40 user nova-compute[75235]: WARNING nova.compute.manager [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received unexpected event network-vif-plugged-62fcb2af-3273-4fdc-b68a-6c0492925844 for instance with vm_state deleted and task_state None.
Nov 29 19:07:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-829904f5-4e25-4f64-ba2e-5e82e49e9710 req-28e7da86-67b9-4437-a5ca-948e4347706c service nova] [instance: eafeb96d-7762-4d67-b3ff-e1221296ecb5] Received event network-vif-deleted-62fcb2af-3273-4fdc-b68a-6c0492925844 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG os_brick.utils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f423c9-a269-4873-b102-aed22598d76d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5184fb88-e4d1-47b5-9830-a820c8a42acb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ab71d9-a841-421f-abb3-a79e1d06da2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3efc87-8cfa-43ca-9ada-cc01f29bbbb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:41 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:07:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cee4db-d6ba-4aff-8531-2484bbeb5684]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:07:41 user nova-compute[75235]: DEBUG os_brick.utils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:41 user nova-compute[75235]: INFO nova.compute.manager [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Swapping volume 1f906b85-9b68-4aab-b077-ba39ac8d29f9 for f0cd5568-0dd6-4adf-9f38-f2c6356a0e54
Nov 29 19:07:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfVsqOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'serial': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8', 'attached_at': '', 'detached_at': '', 'volume_id': '1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'serial'} {{(pid=75235) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 19:07:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:07:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfVsqOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:48 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:48 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:48 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:07:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f6b46e-d9ee-4540-bdca-cd2e531f040f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:07:49 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c9659-4433-4b24-9f29-41b5be2bc607]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54] added
Nov 29 19:07:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[55505de1-9268-4e4b-ab1b-42b09c81d58c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfccd061-dca4-4aad-be40-ec5dc6b1fd0e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJfVsqOM {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJfVsqOM" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7065bce-f085-4b18-b89e-62eb9d4b2762]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJfVsqOM'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef5d1ae-2f35-4145-a342-ef54a83ef0b0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be360b0-5a30-43a0-a22f-437ff3b3d6e3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0902dad2-25d3-4f78-99d8-6d45c9af2482]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260]
Nov 29 19:07:49 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cff51b2-c2d2-485f-9e4d-cc075cf439f5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[516948af-4681-47d9-94f6-d5b59db5fa53]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:07:49 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c7896f-ab91-4942-b6a1-66339bcedffe]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfVsqOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:07:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:07:49 user nova-compute[75235]: INFO nova.compute.manager [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] instance snapshotting
Nov 29 19:07:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Beginning live snapshot process
Nov 29 19:07:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23234646637366334', 'path': '/dev/sdf'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234646637366334', 'path': '/dev/sdf'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG nova.objects.instance [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lazy-loading 'flavor' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.200s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa1o2unr7/4db2317b85704a4f94f72d6ae68861a9.delta 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa1o2unr7/4db2317b85704a4f94f72d6ae68861a9.delta 1073741824" returned: 0 in 0.048s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:50 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:07:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 252706816 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] COPY block job progress, current cursor: 28311552 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 368050176 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:52 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa1o2unr7/4db2317b85704a4f94f72d6ae68861a9.delta /opt/stack/data/nova/instances/snapshots/tmpa1o2unr7/4db2317b85704a4f94f72d6ae68861a9 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 556793856 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa1o2unr7/4db2317b85704a4f94f72d6ae68861a9.delta /opt/stack/data/nova/instances/snapshots/tmpa1o2unr7/4db2317b85704a4f94f72d6ae68861a9" returned: 0 in 0.357s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:53 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Snapshot extracted, beginning image upload
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 627048448 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 789577728 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:53 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 is timed out.
Nov 29 19:07:53 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Successfully detached device vdb from instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 from the live domain config.
Nov 29 19:07:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nYmwSJBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:53 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.188s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a562ab-6bc3-4f0d-a108-ea91e02ee0cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:07:54 user nova-compute[75235]: No targets found.
Nov 29 19:07:54 user nova-compute[75235]: iSNS:
Nov 29 19:07:54 user nova-compute[75235]: No targets found.
Nov 29 19:07:54 user nova-compute[75235]: STATIC:
Nov 29 19:07:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:07:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9
Nov 29 19:07:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65
Nov 29 19:07:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:07:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:54 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54
Nov 29 19:07:54 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:54 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:54 user nova-compute[75235]: FIRMWARE:
Nov 29 19:07:54 user nova-compute[75235]: No targets found.
Nov 29 19:07:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:07:54 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:07:54 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[16477e8c-538f-4fbe-8065-c04dbefe950a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d74a8c-00c4-42fb-af83-0d4b5dc9b8e3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:07:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565823bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3507fec6-00ce-48e2-924c-fdc8d80f5a64]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8171ace-2e01-4e24-9a8b-710d02dd4362]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c620b7-37f4-4b3d-9c13-a3a97557ba93]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a558a2f-180e-47b3-99d6-eb7c12178608]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 925892608 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4efe929-81cd-4076-b358-438777f617c2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1de973-e5db-4fc5-b24a-edf28e152b74]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260]
Nov 29 19:07:54 user nova-compute[75235]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c768b3db-abf8-4ab8-b2d4-06a521245d65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f1515f-bf1d-42c2-8394-fe2c4e101327]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.632s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] <== disconnect_volume: return (636ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:54 user nova-compute[75235]: INFO nova.compute.manager [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Terminating instance
Nov 29 19:07:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1900519d-df6f-4f68-adec-37800bafd35a req-6d05b021-ed75-41cf-bfa7-3be5f578fa9d service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-vif-unplugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1900519d-df6f-4f68-adec-37800bafd35a req-6d05b021-ed75-41cf-bfa7-3be5f578fa9d service nova] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1900519d-df6f-4f68-adec-37800bafd35a req-6d05b021-ed75-41cf-bfa7-3be5f578fa9d service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1900519d-df6f-4f68-adec-37800bafd35a req-6d05b021-ed75-41cf-bfa7-3be5f578fa9d service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1900519d-df6f-4f68-adec-37800bafd35a req-6d05b021-ed75-41cf-bfa7-3be5f578fa9d service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] No waiting events found dispatching network-vif-unplugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1900519d-df6f-4f68-adec-37800bafd35a req-6d05b021-ed75-41cf-bfa7-3be5f578fa9d service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-vif-unplugged-edff818c-f8dd-4410-bdf5-f80442fcb42d for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Instance destroyed successfully.
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.objects.instance [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lazy-loading 'resources' on Instance uuid d55c8d69-fbcb-4513-89a3-cea3e902c3eb {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:55 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1951937975',display_name='tempest-ServersNegativeTestJSON-server-1951937975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1951937975',id=19,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='094885e7831048339ba2cdddd4c67a25',ramdisk_id='',reservation_id='r-ykkq3a1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1781487510',owner_user_name='tempest-ServersNegativeTestJSON-1781487510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:06:11Z,user_data=None,user_id='09c7bffe8af741b1b1f2542f543d20e4',uuid=d55c8d69-fbcb-4513-89a3-cea3e902c3eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converting VIF {"id": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "address": "fa:16:3e:86:7c:de", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff818c-f8", "ovs_interfaceid": "edff818c-f8dd-4410-bdf5-f80442fcb42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_vif [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedff818c-f8, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[63665f8e-fac0-43e0-95cc-54d4156cd615]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:07:55 user nova-compute[75235]: No targets found.
Nov 29 19:07:55 user nova-compute[75235]: iSNS:
Nov 29 19:07:55 user nova-compute[75235]: No targets found.
Nov 29 19:07:55 user nova-compute[75235]: STATIC:
Nov 29 19:07:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:07:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9
Nov 29 19:07:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:07:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54
Nov 29 19:07:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:07:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:07:55 user nova-compute[75235]: FIRMWARE:
Nov 29 19:07:55 user nova-compute[75235]: No targets found.
Nov 29 19:07:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:07:55 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:07:55 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=019f0942-a165-4aed-9a29-11f83be4dc3b) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:07:55 user nova-compute[75235]: INFO os_vif [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:7c:de,bridge_name='br-int',has_traffic_filtering=True,id=edff818c-f8dd-4410-bdf5-f80442fcb42d,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff818c-f8')
Nov 29 19:07:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Deleting instance files /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb_del
Nov 29 19:07:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Deletion of /opt/stack/data/nova/instances/d55c8d69-fbcb-4513-89a3-cea3e902c3eb_del complete
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[059917a3-2a43-480c-922c-b9d73f7750f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1e77ed-fce3-4aba-87d4-5de4ce294f2c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:55 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:55 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:55 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:07:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:07:55 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:07:55 user nova-compute[75235]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:07:55 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:07:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56501a7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: INFO nova.compute.manager [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c15793-b7f8-4380-85bc-2dbd3cf5db94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea389c7-18b5-483f-a80e-af1ab7679047]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d43e33-e681-4f54-ba35-a5c98cbcadff]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6700b67-328e-41e3-b843-8874ff567b61]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ff09b2-a205-48f2-981c-db89d0c39b83]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'flavor' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[586cebcf-34c8-4c7b-81c5-a40a88fa9caa]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]
Nov 29 19:07:55 user nova-compute[75235]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.
Nov 29 19:07:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3b6caad6-7f0e-415a-9b89-960f994f3861 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.353s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e1e3f-6794-46bd-8d92-44f53961affa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] <== disconnect_volume: return (406ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfVsqOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'serial'} {{(pid=75235) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] swap_volume: removing Cinder connection for volume 1f906b85-9b68-4aab-b077-ba39ac8d29f9 {{(pid=75235) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:56 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Took 0.78 seconds to deallocate network for instance.
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] swap_volume: Updating volume 1f906b85-9b68-4aab-b077-ba39ac8d29f9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "QJfVsqOM", "auth_password": "S5ThZCLlU4m31K", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "f0cd5568-0dd6-4adf-9f38-f2c6356a0e54"}, "status": "reserved", "instance": "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8", "attached_at": "", "detached_at": "", "volume_id": "f0cd5568-0dd6-4adf-9f38-f2c6356a0e54", "serial": "f0cd5568-0dd6-4adf-9f38-f2c6356a0e54"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'no_device': None, 'attachment_id': 'fbd85f77-965c-4dd9-bda9-baaf69cf0f57'} {{(pid=75235) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 19:07:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:07:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:07:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=6954MB free_disk=25.280132293701172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-67f3a45f-638d-4d3a-9f34-ca410c543aa5 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.885s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:57 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Snapshot image upload complete
Nov 29 19:07:57 user nova-compute[75235]: INFO nova.compute.manager [None req-80dc8fb0-11ff-4dad-a2b8-9d394d042fdc tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Took 7.42 seconds to snapshot the instance on the hypervisor.
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.804s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.219s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:57 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Deleted allocations for instance d55c8d69-fbcb-4513-89a3-cea3e902c3eb
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] Acquiring lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] No waiting events found dispatching network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:07:57 user nova-compute[75235]: WARNING nova.compute.manager [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received unexpected event network-vif-plugged-edff818c-f8dd-4410-bdf5-f80442fcb42d for instance with vm_state deleted and task_state None.
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-72149a03-cdd3-4cbf-9ca5-3b0e33301367 req-6f8945b5-2a5c-4858-bebd-4740d767ef3f service nova] [instance: d55c8d69-fbcb-4513-89a3-cea3e902c3eb] Received event network-vif-deleted-edff818c-f8dd-4410-bdf5-f80442fcb42d {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-faa24b0e-5222-43ea-b91a-55d21d3dd8de tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "d55c8d69-fbcb-4513-89a3-cea3e902c3eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 68da4f22-a767-4f82-a0fa-e757d8437c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance fd04b533-21ff-408c-9571-2a873100743e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a9079b5c-d793-44b8-b8ef-c326b5082018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG os_brick.utils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd9ab5-be0a-447d-83d2-db6debb07340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3b93d1-dbcb-488f-97da-46f0349f377d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2917c4-9912-45ae-a683-8df9da2eea66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dcb051-0296-45d6-a04d-1e7ffd6b6661]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:07:57 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:07:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a4fa0-2cc5-4744-9aac-d67d9e0275e4]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:07:57 user nova-compute[75235]: DEBUG os_brick.utils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:07:58 user nova-compute[75235]: INFO nova.compute.manager [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Swapping volume f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 for 1f906b85-9b68-4aab-b077-ba39ac8d29f9
Nov 29 19:07:58 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:07:58 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [{"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-9e3e385e-b3ea-4dae-923c-eddacb2a42d7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:07:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8', 'attached_at': '', 'detached_at': '', 'volume_id': '1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'serial': '1f906b85-9b68-4aab-b077-ba39ac8d29f9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfVsqOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54'}, 'status': 'reserved', 'instance': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'serial'} {{(pid=75235) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:08:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:08:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:08:05 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4204e7-63fc-4c91-8d5b-30d2313c2028]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:08:05 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d201241-db12-4926-99df-c00db1a2ae50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9] added
Nov 29 19:08:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47c800-672c-4652-a523-fe7b8d67c8d6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab2043a-00a7-490f-8823-2f9856bfb6c0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFzvgUsG {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFzvgUsG" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba53f73-5bcb-46b8-93f6-b3b9fd16c049]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFzvgUsG'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6201051-e5bb-4679-88e8-205bb9a001c0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c34d2-344b-4363-b0d1-efc7f5bf0e76]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d716fe-e347-444d-b2c1-62c78708df99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]
Nov 29 19:08:05 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.
Nov 29 19:08:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bb9b54-c565-487e-b1f1-420c6d3769d6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8fb9f-9470-4171-a344-ee94412275fc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:08:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2001e-c589-489e-bbe4-ce7d62901406]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:08:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:08:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:08:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23363396563353039', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:08:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363396563353039', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:08:06 user nova-compute[75235]: DEBUG nova.objects.instance [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lazy-loading 'flavor' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:08:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 76546048 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 211812352 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 341835776 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 705691648 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 1062207488 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJfVsqOM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'f0cd5568-0dd6-4adf-9f38-f2c6356a0e54'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:08:11 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb52180-5258-4863-9f31-dad5cacecd1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:08:11 user nova-compute[75235]: No targets found.
Nov 29 19:08:11 user nova-compute[75235]: iSNS:
Nov 29 19:08:11 user nova-compute[75235]: No targets found.
Nov 29 19:08:11 user nova-compute[75235]: STATIC:
Nov 29 19:08:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:08:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9
Nov 29 19:08:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:08:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54
Nov 29 19:08:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:11 user nova-compute[75235]: FIRMWARE:
Nov 29 19:08:11 user nova-compute[75235]: No targets found.
Nov 29 19:08:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:08:11 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:08:11 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8e0cf-f938-4b39-84e5-1e91d6a215bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a449303c-ff86-4f6b-ba83-754b13f5a104]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:11 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:11 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:08:11 user nova-compute[75235]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:08:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:11 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:11 user nova-compute[75235]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 (non-flash)
Nov 29 19:08:11 user nova-compute[75235]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:08:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56503fc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54'): ({'sdf'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Removing single pathed devices sdf {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f89b6c-e315-4604-97b3-70dcf43f7bfd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daffc30-6302-4c9e-a930-66e0f3076300]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Flushing IO for device /dev/sdf {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b5aa8-90b9-4bbc-9c09-e2c80b699a63]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c1f88-3df5-4785-84a1-5685785f90f5]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c2768-bb89-4079-a51a-a3df5917c690]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797e7f9-ab0f-4bc6-869c-07e614c7a096]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260]
Nov 29 19:08:11 user nova-compute[75235]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54, portal: 172.16.0.220,3260] successful.
Nov 29 19:08:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a568dc4a-cb8d-40a6-8afd-7b1470a58588]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] <== disconnect_volume: return (312ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8', 'attached_at': '', 'detached_at': '', 'volume_id': '1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'serial'} {{(pid=75235) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 19:08:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] swap_volume: removing Cinder connection for volume f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 {{(pid=75235) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 19:08:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] swap_volume: Updating volume f0cd5568-0dd6-4adf-9f38-f2c6356a0e54 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MFzvgUsG", "auth_password": "ejwb6lSFkRgMKo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "1f906b85-9b68-4aab-b077-ba39ac8d29f9"}, "status": "reserved", "instance": "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8", "attached_at": "", "detached_at": "", "volume_id": "1f906b85-9b68-4aab-b077-ba39ac8d29f9", "serial": "1f906b85-9b68-4aab-b077-ba39ac8d29f9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'no_device': None, 'attachment_id': 'adf54004-0197-43e3-a76a-35b67a699f50'} {{(pid=75235) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 19:08:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f301e6-614d-4a00-8999-6c032e592849 tempest-TestVolumeSwap-624571431 tempest-TestVolumeSwap-624571431-project-admin] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.927s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:13 user nova-compute[75235]: INFO nova.compute.manager [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Detaching volume 1f906b85-9b68-4aab-b077-ba39ac8d29f9
Nov 29 19:08:13 user nova-compute[75235]: INFO nova.virt.block_device [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Attempting to driver detach volume 1f906b85-9b68-4aab-b077-ba39ac8d29f9 from mountpoint /dev/vdb
Nov 29 19:08:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Attempting to detach device vdb from instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:08:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:08:13 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:08:13 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:08:13 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:08:13 user nova-compute[75235]:   <serial>1f906b85-9b68-4aab-b077-ba39ac8d29f9</serial>
Nov 29 19:08:13 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:08:13 user nova-compute[75235]: </disk>
Nov 29 19:08:13 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:08:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Successfully detached device vdb from instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 from the persistent domain config.
Nov 29 19:08:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:08:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:08:13 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:08:13 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:08:13 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:08:13 user nova-compute[75235]:   <serial>1f906b85-9b68-4aab-b077-ba39ac8d29f9</serial>
Nov 29 19:08:13 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:08:13 user nova-compute[75235]: </disk>
Nov 29 19:08:13 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:08:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:08:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:24 user nova-compute[75235]: INFO nova.compute.manager [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Terminating instance
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-f6fe1f34-7190-422c-a089-c7943d6e259a req-6cfe8af3-c56b-4407-b668-bd367ba73fab service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f6fe1f34-7190-422c-a089-c7943d6e259a req-6cfe8af3-c56b-4407-b668-bd367ba73fab service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f6fe1f34-7190-422c-a089-c7943d6e259a req-6cfe8af3-c56b-4407-b668-bd367ba73fab service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f6fe1f34-7190-422c-a089-c7943d6e259a req-6cfe8af3-c56b-4407-b668-bd367ba73fab service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-f6fe1f34-7190-422c-a089-c7943d6e259a req-6cfe8af3-c56b-4407-b668-bd367ba73fab service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-f6fe1f34-7190-422c-a089-c7943d6e259a req-6cfe8af3-c56b-4407-b668-bd367ba73fab service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-unplugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Instance destroyed successfully.
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lazy-loading 'resources' on Instance uuid 9e3e385e-b3ea-4dae-923c-eddacb2a42d7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-710912652',display_name='tempest-ServerStableDeviceRescueTest-server-710912652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-710912652',id=4,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEE4xxI+rQAyw/TzS9A4k6eJoe1wHbvSnlCb5Nulp5mkRRugqtYAQDnxmY/dTLGRZaveb1cl3jcqZZS93b/kPlX06OJHF035hxQSxdyQNHDmeTHLtUvPxUQmDXyo+SK9A==',key_name='tempest-keypair-2119009507',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff5711373c84c64ae6e6b37a2b6e6e7',ramdisk_id='',reservation_id='r-0mqvpcox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2102571705',owner_user_name='tempest-ServerStableDeviceRescueTest-2102571705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:07:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a8c2e833baa4dd9b5e747cb9b80d0d8',uuid=9e3e385e-b3ea-4dae-923c-eddacb2a42d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converting VIF {"id": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "address": "fa:16:3e:fe:ec:c3", "network": {"id": "fc45aba1-c370-4b22-a4db-ebaf195b92c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2147040700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff5711373c84c64ae6e6b37a2b6e6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3569ef3-c3", "ovs_interfaceid": "e3569ef3-c352-424a-8e4a-2be65c7de3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG os_vif [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3569ef3-c3, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f50aed40-79eb-4b93-a129-a15c8aaa9ef6) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:08:24 user nova-compute[75235]: INFO os_vif [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ec:c3,bridge_name='br-int',has_traffic_filtering=True,id=e3569ef3-c352-424a-8e4a-2be65c7de3a5,network=Network(fc45aba1-c370-4b22-a4db-ebaf195b92c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3569ef3-c3')
Nov 29 19:08:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Deleting instance files /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7_del
Nov 29 19:08:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Deletion of /opt/stack/data/nova/instances/9e3e385e-b3ea-4dae-923c-eddacb2a42d7_del complete
Nov 29 19:08:24 user nova-compute[75235]: INFO nova.compute.manager [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 19:08:24 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:08:24 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:08:25 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:08:25 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Took 0.88 seconds to deallocate network for instance.
Nov 29 19:08:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-2d01db17-83bc-4a9b-8c07-0dce8919f0ab req-29c06222-6fb5-4679-8fd3-d76a23119807 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-deleted-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:26 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Deleted allocations for instance 9e3e385e-b3ea-4dae-923c-eddacb2a42d7
Nov 29 19:08:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0be282ed-d9ab-4ad6-8515-98e745df6177 tempest-ServerStableDeviceRescueTest-2102571705 tempest-ServerStableDeviceRescueTest-2102571705-project-member] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.358s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-3284605e-ecc7-49bb-bb09-4d1db3802871 req-698abc3f-a7ba-4e03-ac0b-cb1d72ecae53 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3284605e-ecc7-49bb-bb09-4d1db3802871 req-698abc3f-a7ba-4e03-ac0b-cb1d72ecae53 service nova] Acquiring lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3284605e-ecc7-49bb-bb09-4d1db3802871 req-698abc3f-a7ba-4e03-ac0b-cb1d72ecae53 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3284605e-ecc7-49bb-bb09-4d1db3802871 req-698abc3f-a7ba-4e03-ac0b-cb1d72ecae53 service nova] Lock "9e3e385e-b3ea-4dae-923c-eddacb2a42d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-3284605e-ecc7-49bb-bb09-4d1db3802871 req-698abc3f-a7ba-4e03-ac0b-cb1d72ecae53 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] No waiting events found dispatching network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:08:26 user nova-compute[75235]: WARNING nova.compute.manager [req-3284605e-ecc7-49bb-bb09-4d1db3802871 req-698abc3f-a7ba-4e03-ac0b-cb1d72ecae53 service nova] [instance: 9e3e385e-b3ea-4dae-923c-eddacb2a42d7] Received unexpected event network-vif-plugged-e3569ef3-c352-424a-8e4a-2be65c7de3a5 for instance with vm_state deleted and task_state None.
Nov 29 19:08:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:08:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:29 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:08:29 user nova-compute[75235]: INFO nova.compute.claims [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Claim successful on node user
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:08:30 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.policy [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '556161926cf5420b82b6f33221ac8fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f049b77ff5714114a8808a39c57e1a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:08:30 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Creating image(s)
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk 1073741824" returned: 0 in 0.061s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Successfully created port: d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Cannot resize image /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Ensure instance console log exists: /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Successfully updated port: d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing instance network info cache due to event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance network_info: |[{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.neutron [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Start _get_guest_xml network_info=[{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:08:32 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:08:32 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1625356192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1625356192',id=24,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEpJcpTjeHMDxai3qqEOAIdCA0v7Hr+RNymMwe4pAA+ygLaCmvGzLhi16aFKVACV9WcFl6xJTdZkVhdfg4rGF5Fyzwqqdu4T5Xc/1zHFL3waCjPT+Dv6CmAPn5ehWpt9A==',key_name='tempest-keypair-1274433502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-l4j9sl90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=20d745cf-cd85-4943-a03e-b6f9a3e0bafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'pci_devices' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:08:32 user nova-compute[75235]:   <uuid>20d745cf-cd85-4943-a03e-b6f9a3e0bafe</uuid>
Nov 29 19:08:32 user nova-compute[75235]:   <name>instance-00000018</name>
Nov 29 19:08:32 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:08:32 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:08:32 user nova-compute[75235]:   <metadata>
Nov 29 19:08:32 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:08:32 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:08:32 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1625356192</nova:name>
Nov 29 19:08:32 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:08:32</nova:creationTime>
Nov 29 19:08:32 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:08:32 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:08:32 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:08:32 user nova-compute[75235]:       <nova:owner>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:user uuid="556161926cf5420b82b6f33221ac8fb4">tempest-AttachVolumeShelveTestJSON-850280898-project-member</nova:user>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:project uuid="f049b77ff5714114a8808a39c57e1a94">tempest-AttachVolumeShelveTestJSON-850280898</nova:project>
Nov 29 19:08:32 user nova-compute[75235]:       </nova:owner>
Nov 29 19:08:32 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:08:32 user nova-compute[75235]:       <nova:ports>
Nov 29 19:08:32 user nova-compute[75235]:         <nova:port uuid="d8e45ee5-1a5b-47aa-a478-93f107bf9788">
Nov 29 19:08:32 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:08:32 user nova-compute[75235]:         </nova:port>
Nov 29 19:08:32 user nova-compute[75235]:       </nova:ports>
Nov 29 19:08:32 user nova-compute[75235]:     </nova:instance>
Nov 29 19:08:32 user nova-compute[75235]:   </metadata>
Nov 29 19:08:32 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:08:32 user nova-compute[75235]:     <system>
Nov 29 19:08:32 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:08:32 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:08:32 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:08:32 user nova-compute[75235]:       <entry name="serial">20d745cf-cd85-4943-a03e-b6f9a3e0bafe</entry>
Nov 29 19:08:32 user nova-compute[75235]:       <entry name="uuid">20d745cf-cd85-4943-a03e-b6f9a3e0bafe</entry>
Nov 29 19:08:32 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:08:32 user nova-compute[75235]:     </system>
Nov 29 19:08:32 user nova-compute[75235]:   </sysinfo>
Nov 29 19:08:32 user nova-compute[75235]:   <os>
Nov 29 19:08:32 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:08:32 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:08:32 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:08:32 user nova-compute[75235]:   </os>
Nov 29 19:08:32 user nova-compute[75235]:   <features>
Nov 29 19:08:32 user nova-compute[75235]:     <acpi/>
Nov 29 19:08:32 user nova-compute[75235]:     <apic/>
Nov 29 19:08:32 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:08:32 user nova-compute[75235]:   </features>
Nov 29 19:08:32 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:08:32 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:08:32 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:08:32 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:08:32 user nova-compute[75235]:   </clock>
Nov 29 19:08:32 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:08:32 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:08:32 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:08:32 user nova-compute[75235]:   </cpu>
Nov 29 19:08:32 user nova-compute[75235]:   <devices>
Nov 29 19:08:32 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:08:32 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:08:32 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk"/>
Nov 29 19:08:32 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:08:32 user nova-compute[75235]:     </disk>
Nov 29 19:08:32 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:08:32 user nova-compute[75235]:       <mac address="fa:16:3e:a4:9a:b4"/>
Nov 29 19:08:32 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:08:32 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:08:32 user nova-compute[75235]:       <target dev="tapd8e45ee5-1a"/>
Nov 29 19:08:32 user nova-compute[75235]:     </interface>
Nov 29 19:08:32 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:08:32 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/console.log" append="off"/>
Nov 29 19:08:32 user nova-compute[75235]:     </serial>
Nov 29 19:08:32 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:08:32 user nova-compute[75235]:     <video>
Nov 29 19:08:32 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:08:32 user nova-compute[75235]:     </video>
Nov 29 19:08:32 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:08:32 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:08:32 user nova-compute[75235]:     </rng>
Nov 29 19:08:32 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:08:32 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:08:32 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:08:32 user nova-compute[75235]:     </memballoon>
Nov 29 19:08:32 user nova-compute[75235]:   </devices>
Nov 29 19:08:32 user nova-compute[75235]: </domain>
Nov 29 19:08:32 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1625356192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1625356192',id=24,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEpJcpTjeHMDxai3qqEOAIdCA0v7Hr+RNymMwe4pAA+ygLaCmvGzLhi16aFKVACV9WcFl6xJTdZkVhdfg4rGF5Fyzwqqdu4T5Xc/1zHFL3waCjPT+Dv6CmAPn5ehWpt9A==',key_name='tempest-keypair-1274433502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-l4j9sl90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=20d745cf-cd85-4943-a03e-b6f9a3e0bafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG os_vif [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dd2774a-52ff-54d7-bd1b-db43aeabb89c', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8e45ee5-1a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8e45ee5-1a, col_values=(('qos', UUID('07f486a1-a174-4894-93bf-a22da5306ce6')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8e45ee5-1a, col_values=(('external_ids', {'iface-id': 'd8e45ee5-1a5b-47aa-a478-93f107bf9788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:9a:b4', 'vm-uuid': '20d745cf-cd85-4943-a03e-b6f9a3e0bafe'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:32 user nova-compute[75235]: INFO os_vif [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a')
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:08:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No VIF found with MAC fa:16:3e:a4:9a:b4, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updated VIF entry in instance network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-dc109266-a971-4520-aa2d-46f100843657 req-131e2176-f8d9-43ee-95a5-aef9b22b364d service nova] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-changed-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Refreshing instance network info cache due to event network-changed-644e59e3-44e4-43e5-8d47-a226b1457182. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Refreshing network info cache for port 644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updated VIF entry in instance network info cache for port 644e59e3-44e4-43e5-8d47-a226b1457182. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf3dfa73-d979-48a0-b1b0-8e62e0e3bd95 req-7da66964-75f0-40dd-85a3-ba100a3ae0ca service nova] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:08:33 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 is timed out.
Nov 29 19:08:33 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Successfully detached device vdb from instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 from the live domain config.
Nov 29 19:08:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFzvgUsG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '1f906b85-9b68-4aab-b077-ba39ac8d29f9'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:08:33 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0ec170-6021-409c-8e49-a4495f69d2e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:08:33 user nova-compute[75235]: No targets found.
Nov 29 19:08:33 user nova-compute[75235]: iSNS:
Nov 29 19:08:33 user nova-compute[75235]: No targets found.
Nov 29 19:08:33 user nova-compute[75235]: STATIC:
Nov 29 19:08:33 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:08:33 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:33 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:33 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9
Nov 29 19:08:33 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:33 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:33 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:08:33 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:33 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:33 user nova-compute[75235]: FIRMWARE:
Nov 29 19:08:33 user nova-compute[75235]: No targets found.
Nov 29 19:08:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:08:33 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:08:33 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9731ec6a-d363-46cd-b0c9-7ac022b16a0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12b02da-65d7-4e35-9a0a-c92537278613]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:33 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:33 user nova-compute[75235]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:08:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:33 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:33 user nova-compute[75235]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 (non-flash)
Nov 29 19:08:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c779e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:08:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8456a04-3cab-46f2-9739-9bd7328bfa33]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2541867-e320-43c3-b539-ab7eb8adaf34]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e08f28-37d0-49ae-bd20-943cd3c3f073]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b99054a-4575-4e97-af24-e756fd2b07a5]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[da308f20-6751-4632-ba6a-3da0d647716e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac32d623-82ee-4094-8106-2b36a501e6b9]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260]
Nov 29 19:08:34 user nova-compute[75235]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9, portal: 172.16.0.220,3260] successful.
Nov 29 19:08:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f906b85-9b68-4aab-b077-ba39ac8d29f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9181373-360b-4843-983a-70ad0b93f0d1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] <== disconnect_volume: return (317ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG nova.objects.instance [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lazy-loading 'flavor' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-217bea4b-559e-4e97-bef2-23147a08be06 tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:08:35 user nova-compute[75235]: WARNING nova.compute.manager [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state building and task_state spawning.
Nov 29 19:08:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:08:35 user nova-compute[75235]: WARNING nova.compute.manager [req-910fe5eb-2594-4a21-b723-3e82c8c69b10 req-913a0c40-fb62-4ab6-a915-9b48881d6074 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state building and task_state spawning.
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:08:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance spawned successfully.
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:08:36 user nova-compute[75235]: INFO nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 29 19:08:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:08:36 user nova-compute[75235]: INFO nova.compute.manager [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Took 6.98 seconds to build instance.
Nov 29 19:08:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ce2f14-d523-4297-815c-a096612bb788 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.148s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-changed-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Refreshing instance network info cache due to event network-changed-97293492-a506-48cb-aa5a-2cba15a33988. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:08:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] Acquiring lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:08:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] Acquired lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:08:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Refreshing network info cache for port 97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:08:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updated VIF entry in instance network info cache for port 97293492-a506-48cb-aa5a-2cba15a33988. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:08:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updating instance_info_cache with network_info: [{"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:08:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b7ad83b-f8dc-4527-a4b3-b28ebfd0795c req-88a0accd-45bf-4671-bb19-c97e758662ae service nova] Releasing lock "refresh_cache-68da4f22-a767-4f82-a0fa-e757d8437c1d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:08:39 user nova-compute[75235]: INFO nova.compute.manager [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Rebuilding instance
Nov 29 19:08:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-ea40dbe9-33d5-440b-ad6c-9152c8569390 req-8db1f089-39c8-4a68-a380-2b3bcebcec4e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-unplugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ea40dbe9-33d5-440b-ad6c-9152c8569390 req-8db1f089-39c8-4a68-a380-2b3bcebcec4e service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ea40dbe9-33d5-440b-ad6c-9152c8569390 req-8db1f089-39c8-4a68-a380-2b3bcebcec4e service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ea40dbe9-33d5-440b-ad6c-9152c8569390 req-8db1f089-39c8-4a68-a380-2b3bcebcec4e service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-ea40dbe9-33d5-440b-ad6c-9152c8569390 req-8db1f089-39c8-4a68-a380-2b3bcebcec4e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-unplugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:08:39 user nova-compute[75235]: WARNING nova.compute.manager [req-ea40dbe9-33d5-440b-ad6c-9152c8569390 req-8db1f089-39c8-4a68-a380-2b3bcebcec4e service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-unplugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state active and task_state rebuilding.
Nov 29 19:08:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance destroyed successfully.
Nov 29 19:08:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance destroyed successfully.
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1104868735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1047567644',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI66VmULyd9ckKxIHCFeqsXCYg/QSiaHvW1iAxP1EMxJ/4CTxOTWXE/izpcbRPZjsIXsx+mjuN86ozzO8VxEQ8qrf2Qje0qP6MElQeVrdKCkA7YqK6sFocX0Lkbu/6+sw==',key_name='tempest-keypair-471369165',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f47892237b941b5a5c3907e0fda8833',ramdisk_id='',reservation_id='r-cq80ikws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2075615192',owner_user_name='tempest-ServerActionsV293TestJSON-2075615192-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82dcae401a574847b3262ee209963897',uuid=68da4f22-a767-4f82-a0fa-e757d8437c1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converting VIF {"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97293492-a5, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b5b0bae-2808-4a72-9c75-e93108f9bba4) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:08:40 user nova-compute[75235]: INFO os_vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5')
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:08:40 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d06db66-0937-4155-9c1b-c1a1c119f6d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:08:40 user nova-compute[75235]: No targets found.
Nov 29 19:08:40 user nova-compute[75235]: iSNS:
Nov 29 19:08:40 user nova-compute[75235]: No targets found.
Nov 29 19:08:40 user nova-compute[75235]: STATIC:
Nov 29 19:08:40 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:08:40 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:40 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:40 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:08:40 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:40 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:40 user nova-compute[75235]: FIRMWARE:
Nov 29 19:08:40 user nova-compute[75235]: No targets found.
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:08:40 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:08:40 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b5327-1e7a-49d3-918c-191cb011b7e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb4bb16-bcc7-42fa-a838-7027f31e47c2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:40 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:08:40 user nova-compute[75235]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c778550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a'): ({'sde'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Removing single pathed devices sde {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2cdd1-1768-4f2d-a919-ab7bf63c23a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e99c94-ae96-44b5-8a3c-8feef50c8702]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Flushing IO for device /dev/sde {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95c2f5-4182-4263-bd44-ba6e7aff212b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[21192c6f-4e9a-448d-99bc-0dc46dd8707a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO32b62b4-fdf6e7b3ba895ab1', '/dev/disk/by-id/scsi-26664663665376233', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_32b62b4') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:08:40 user nova-compute[75235]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO32b62b4-fdf6e7b3ba895ab1
Nov 29 19:08:40 user nova-compute[75235]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26664663665376233
Nov 29 19:08:40 user nova-compute[75235]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_32b62b4
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6ef70d-6219-4c08-878f-f09b420d2a67]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cf4e5d-54f2-4a28-ba4c-c1a847d36556]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6362506-8813-497b-8512-cd39b1869466]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]
Nov 29 19:08:40 user nova-compute[75235]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0618d978-ea82-4359-a132-0a831e1577cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== disconnect_volume: return (317ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:08:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Deleting instance files /opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d_del
Nov 29 19:08:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Deletion of /opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d_del complete
Nov 29 19:08:40 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 68da4f22-a767-4f82-a0fa-e757d8437c1d could not be found.
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:08:40 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5d4600-6d4e-4ad2-94a9-dab5dbccda0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:08:40 user nova-compute[75235]: No targets found.
Nov 29 19:08:40 user nova-compute[75235]: iSNS:
Nov 29 19:08:40 user nova-compute[75235]: No targets found.
Nov 29 19:08:40 user nova-compute[75235]: STATIC:
Nov 29 19:08:40 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:08:40 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:08:40 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:08:40 user nova-compute[75235]: FIRMWARE:
Nov 29 19:08:40 user nova-compute[75235]: No targets found.
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:08:40 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:08:40 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa4564-b810-41cc-9e1d-1044c1a13323]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2985fc85-a69b-4882-9434-793c1c3b5cca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:08:40 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56501ee5f0>, {}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Disconnecting from: [] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== disconnect_volume: return (80ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:08:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-05695efc-808d-45b2-aba7-8875ac5019d8 req-75deb55e-8ec1-4344-b6f7-e20f296ceb8b service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-05695efc-808d-45b2-aba7-8875ac5019d8 req-75deb55e-8ec1-4344-b6f7-e20f296ceb8b service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-05695efc-808d-45b2-aba7-8875ac5019d8 req-75deb55e-8ec1-4344-b6f7-e20f296ceb8b service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-05695efc-808d-45b2-aba7-8875ac5019d8 req-75deb55e-8ec1-4344-b6f7-e20f296ceb8b service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-05695efc-808d-45b2-aba7-8875ac5019d8 req-75deb55e-8ec1-4344-b6f7-e20f296ceb8b service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:08:41 user nova-compute[75235]: WARNING nova.compute.manager [req-05695efc-808d-45b2-aba7-8875ac5019d8 req-75deb55e-8ec1-4344-b6f7-e20f296ceb8b service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state active and task_state rebuilding.
Nov 29 19:08:41 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Preparing to wait for external event volume-reimaged-8693a058-3366-457b-800f-8db54e05e50a {{(pid=75235) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:08:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:08:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=25.342437744140625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 68da4f22-a767-4f82-a0fa-e757d8437c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance fd04b533-21ff-408c-9571-2a873100743e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a9079b5c-d793-44b8-b8ef-c326b5082018 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 20d745cf-cd85-4943-a03e-b6f9a3e0bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:08:54 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:08:55 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:08:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:08:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:08:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:08:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:08:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:08:59 user nova-compute[75235]: INFO nova.compute.manager [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Unshelving
Nov 29 19:08:59 user nova-compute[75235]: INFO nova.virt.block_device [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Booting with volume 5c384bd6-f224-4711-aa47-ee9a16ca9bff at /dev/vda
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f77f3-8973-47e4-a5cf-990b49885601]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8431587-4d0c-47d6-9e48-89e67fd5bce2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c094cf-7cdc-4726-ac3b-153c8ac52c95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81da06-40cc-4856-b972-fe835042e9df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:00 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1340dd42-3154-4a2c-acb1-f5a79ac9059e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating existing volume attachment record: c0fbb0ac-3883-43ff-b1dd-29614a7803c5 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-4803f94b-3987-4b23-87bf-350ce8cdaf39 req-2a6807f0-cabb-48e6-a021-409a3ee321d5 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event volume-reimaged-8693a058-3366-457b-800f-8db54e05e50a {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4803f94b-3987-4b23-87bf-350ce8cdaf39 req-2a6807f0-cabb-48e6-a021-409a3ee321d5 service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4803f94b-3987-4b23-87bf-350ce8cdaf39 req-2a6807f0-cabb-48e6-a021-409a3ee321d5 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4803f94b-3987-4b23-87bf-350ce8cdaf39 req-2a6807f0-cabb-48e6-a021-409a3ee321d5 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-4803f94b-3987-4b23-87bf-350ce8cdaf39 req-2a6807f0-cabb-48e6-a021-409a3ee321d5 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Processing event volume-reimaged-8693a058-3366-457b-800f-8db54e05e50a {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:09:00 user nova-compute[75235]: INFO nova.virt.block_device [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Booting with volume 8693a058-3366-457b-800f-8db54e05e50a at /dev/vda
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[119cbb32-a576-4e5a-b5bd-74ba5743644b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[449f7a40-8881-4810-afc9-462cffb07296]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e6d204-82bb-495a-8781-c793f31db821]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f2029-785c-4484-9b56-8c19106e2196]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:00 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e75dd-ef60-4bb0-8e77-0e7a1fe14c9f]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updating existing volume attachment record: 40c945ef-6cbe-49f5-8270-94851fd0c820 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:09:00 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:03 user nova-compute[75235]: INFO nova.compute.manager [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Terminating instance
Nov 29 19:09:03 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-719fa1dd-eb9b-40e8-bb1e-854f1a7baa8b req-bb405fd5-4580-4e28-abe0-e7fe5c7060c4 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-vif-unplugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-719fa1dd-eb9b-40e8-bb1e-854f1a7baa8b req-bb405fd5-4580-4e28-abe0-e7fe5c7060c4 service nova] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-719fa1dd-eb9b-40e8-bb1e-854f1a7baa8b req-bb405fd5-4580-4e28-abe0-e7fe5c7060c4 service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-719fa1dd-eb9b-40e8-bb1e-854f1a7baa8b req-bb405fd5-4580-4e28-abe0-e7fe5c7060c4 service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-719fa1dd-eb9b-40e8-bb1e-854f1a7baa8b req-bb405fd5-4580-4e28-abe0-e7fe5c7060c4 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] No waiting events found dispatching network-vif-unplugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-719fa1dd-eb9b-40e8-bb1e-854f1a7baa8b req-bb405fd5-4580-4e28-abe0-e7fe5c7060c4 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-vif-unplugged-5669e733-8a19-4c66-8b64-0c538a0d3674 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Instance destroyed successfully.
Nov 29 19:09:04 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lazy-loading 'resources' on Instance uuid cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1612128584',display_name='tempest-TestVolumeSwap-server-1612128584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1612128584',id=17,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8qetv5NTuGjubGWswjAuziXRdPFli0kd+7AteL9QoxMIhw74liBslFwLgHJZ3H61reEqz0aZ/j6HygCFLrpfe3vp4W+ed7vzokKE5Naqf5r5Tgqd6mnjDLFH7zwVDnEw==',key_name='tempest-keypair-123751440',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f7748eb48204224af05f0bce1d75413',ramdisk_id='',reservation_id='r-wqm3p16z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-329242883',owner_user_name='tempest-TestVolumeSwap-329242883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7f8de6a84e448793e54933003a3e4c',uuid=cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Converting VIF {"id": "5669e733-8a19-4c66-8b64-0c538a0d3674", "address": "fa:16:3e:d7:4c:12", "network": {"id": "9a7db334-5168-4ff4-84c0-4400be167463", "bridge": "br-int", "label": "tempest-TestVolumeSwap-782335553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f7748eb48204224af05f0bce1d75413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5669e733-8a", "ovs_interfaceid": "5669e733-8a19-4c66-8b64-0c538a0d3674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG os_vif [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5669e733-8a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c0d9465-d7ec-4143-80eb-fefc3106deae) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:04 user nova-compute[75235]: INFO os_vif [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:4c:12,bridge_name='br-int',has_traffic_filtering=True,id=5669e733-8a19-4c66-8b64-0c538a0d3674,network=Network(9a7db334-5168-4ff4-84c0-4400be167463),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5669e733-8a')
Nov 29 19:09:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Deleting instance files /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8_del
Nov 29 19:09:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Deletion of /opt/stack/data/nova/instances/cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8_del complete
Nov 29 19:09:04 user nova-compute[75235]: INFO nova.compute.manager [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 19:09:04 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:09:04 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:09:05 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:05 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Took 0.90 seconds to deallocate network for instance.
Nov 29 19:09:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-ee1a69b9-a510-4c32-b532-8f251522c891 req-dcd0875f-a5d5-4836-8980-bfec7d1a6fe1 service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-vif-deleted-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:05 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:05 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:05 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Deleted allocations for instance cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8
Nov 29 19:09:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4837168e-3ff4-4de2-91f3-ed0464b3381a tempest-TestVolumeSwap-329242883 tempest-TestVolumeSwap-329242883-project-member] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-2264e193-5514-4099-b65e-b49a8bac3ab1 req-091e8ca5-354c-4710-8e6c-7ef70ee3121d service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received event network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2264e193-5514-4099-b65e-b49a8bac3ab1 req-091e8ca5-354c-4710-8e6c-7ef70ee3121d service nova] Acquiring lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2264e193-5514-4099-b65e-b49a8bac3ab1 req-091e8ca5-354c-4710-8e6c-7ef70ee3121d service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2264e193-5514-4099-b65e-b49a8bac3ab1 req-091e8ca5-354c-4710-8e6c-7ef70ee3121d service nova] Lock "cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-2264e193-5514-4099-b65e-b49a8bac3ab1 req-091e8ca5-354c-4710-8e6c-7ef70ee3121d service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] No waiting events found dispatching network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:06 user nova-compute[75235]: WARNING nova.compute.manager [req-2264e193-5514-4099-b65e-b49a8bac3ab1 req-091e8ca5-354c-4710-8e6c-7ef70ee3121d service nova] [instance: cac8e3bb-e6bf-48c6-8b97-dbf0e5b245a8] Received unexpected event network-vif-plugged-5669e733-8a19-4c66-8b64-0c538a0d3674 for instance with vm_state deleted and task_state None.
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-changed-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Refreshing instance network info cache due to event network-changed-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] Acquiring lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] Acquired lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.network.neutron [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Refreshing network info cache for port 2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.objects.instance [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'pci_requests' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.objects.instance [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'numa_topology' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:09:08 user nova-compute[75235]: INFO nova.compute.claims [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Claim successful on node user
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:09:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Creating image(s)
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Start _get_guest_xml network_info=[{"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '40c945ef-6cbe-49f5-8270-94851fd0c820', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68da4f22-a767-4f82-a0fa-e757d8437c1d', 'attached_at': '', 'detached_at': '', 'volume_id': '8693a058-3366-457b-800f-8db54e05e50a', 'serial': '8693a058-3366-457b-800f-8db54e05e50a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 19:09:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.network.neutron [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updated VIF entry in instance network info cache for port 2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.network.neutron [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updating instance_info_cache with network_info: [{"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68da4f22-a767-4f82-a0fa-e757d8437c1d {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ba82d51f-5891-4b10-a2c2-626d2b27b5c2 req-f7be6fbf-867e-412d-aee9-36d6ac36012f service nova] Releasing lock "refresh_cache-fd04b533-21ff-408c-9571-2a873100743e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:08 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:09:08 user nova-compute[75235]: INFO nova.network.neutron [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c23f41a-b5f0-45aa-beb8-2f18f2aaeceb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:09:08 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba6e20d-579d-4558-971d-921107cefd86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a] added
Nov 29 19:09:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9516f116-1d1c-465d-9c95-9855e513ac02]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b28438e-653f-4960-92be-b968e2e3d511]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwnmWAhH {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwnmWAhH" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[197b6a84-f79f-4752-bab0-24bf2c38299c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SwnmWAhH'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab63088-2df5-450b-b92b-06adcfd67172]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d29368b-0308-465f-b73a-8168f8b3388a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbd2ce-7a57-4fee-9b42-ba677c248e3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]
Nov 29 19:09:08 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.
Nov 29 19:09:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa031ab2-e462-4b2e-96d9-7ab2a933b6f7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0362c54-35cf-4ec6-b847-de73fe2d6887]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:09 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:09 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:09 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:09 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060a2c8-d67d-4044-9955-6ef3f9f1d078]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing instance network info cache due to event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:09:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:09:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Creating image(s)
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Ensure instance console log exists: /opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Start _get_guest_xml network_info=[{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'c0fbb0ac-3883-43ff-b1dd-29614a7803c5', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03f7d056-56b5-45ba-a6e1-3449e35b9728', 'attached_at': '', 'detached_at': '', 'volume_id': '5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'serial': '5c384bd6-f224-4711-aa47-ee9a16ca9bff'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:09:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26664663665376233', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664663665376233', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Object Instance<03f7d056-56b5-45ba-a6e1-3449e35b9728> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:10 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:10 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:10 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1104868735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1047567644',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI66VmULyd9ckKxIHCFeqsXCYg/QSiaHvW1iAxP1EMxJ/4CTxOTWXE/izpcbRPZjsIXsx+mjuN86ozzO8VxEQ8qrf2Qje0qP6MElQeVrdKCkA7YqK6sFocX0Lkbu/6+sw==',key_name='tempest-keypair-471369165',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f47892237b941b5a5c3907e0fda8833',ramdisk_id='',reservation_id='r-cq80ikws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2075615192',owner_user_name='tempest-ServerActionsV293TestJSON-2075615192-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82dcae401a574847b3262ee209963897',uuid=68da4f22-a767-4f82-a0fa-e757d8437c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converting VIF {"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:09:10 user nova-compute[75235]:   <uuid>68da4f22-a767-4f82-a0fa-e757d8437c1d</uuid>
Nov 29 19:09:10 user nova-compute[75235]:   <name>instance-00000015</name>
Nov 29 19:09:10 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:09:10 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:09:10 user nova-compute[75235]:   <metadata>
Nov 29 19:09:10 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:09:10 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:09:10 user nova-compute[75235]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1104868735</nova:name>
Nov 29 19:09:10 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:09:08</nova:creationTime>
Nov 29 19:09:10 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:09:10 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:09:10 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:09:10 user nova-compute[75235]:       <nova:owner>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:user uuid="82dcae401a574847b3262ee209963897">tempest-ServerActionsV293TestJSON-2075615192-project-member</nova:user>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:project uuid="3f47892237b941b5a5c3907e0fda8833">tempest-ServerActionsV293TestJSON-2075615192</nova:project>
Nov 29 19:09:10 user nova-compute[75235]:       </nova:owner>
Nov 29 19:09:10 user nova-compute[75235]:       <nova:ports>
Nov 29 19:09:10 user nova-compute[75235]:         <nova:port uuid="97293492-a506-48cb-aa5a-2cba15a33988">
Nov 29 19:09:10 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:09:10 user nova-compute[75235]:         </nova:port>
Nov 29 19:09:10 user nova-compute[75235]:       </nova:ports>
Nov 29 19:09:10 user nova-compute[75235]:     </nova:instance>
Nov 29 19:09:10 user nova-compute[75235]:   </metadata>
Nov 29 19:09:10 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:09:10 user nova-compute[75235]:     <system>
Nov 29 19:09:10 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:09:10 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:09:10 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:09:10 user nova-compute[75235]:       <entry name="serial">68da4f22-a767-4f82-a0fa-e757d8437c1d</entry>
Nov 29 19:09:10 user nova-compute[75235]:       <entry name="uuid">68da4f22-a767-4f82-a0fa-e757d8437c1d</entry>
Nov 29 19:09:10 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:09:10 user nova-compute[75235]:     </system>
Nov 29 19:09:10 user nova-compute[75235]:   </sysinfo>
Nov 29 19:09:10 user nova-compute[75235]:   <os>
Nov 29 19:09:10 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:09:10 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:09:10 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:09:10 user nova-compute[75235]:   </os>
Nov 29 19:09:10 user nova-compute[75235]:   <features>
Nov 29 19:09:10 user nova-compute[75235]:     <acpi/>
Nov 29 19:09:10 user nova-compute[75235]:     <apic/>
Nov 29 19:09:10 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:09:10 user nova-compute[75235]:   </features>
Nov 29 19:09:10 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:09:10 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:09:10 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:09:10 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:09:10 user nova-compute[75235]:   </clock>
Nov 29 19:09:10 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:09:10 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:09:10 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:09:10 user nova-compute[75235]:   </cpu>
Nov 29 19:09:10 user nova-compute[75235]:   <devices>
Nov 29 19:09:10 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:09:10 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:10 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:09:10 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:09:10 user nova-compute[75235]:       <serial>8693a058-3366-457b-800f-8db54e05e50a</serial>
Nov 29 19:09:10 user nova-compute[75235]:     </disk>
Nov 29 19:09:10 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:09:10 user nova-compute[75235]:       <mac address="fa:16:3e:8c:6e:e4"/>
Nov 29 19:09:10 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:10 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:09:10 user nova-compute[75235]:       <target dev="tap97293492-a5"/>
Nov 29 19:09:10 user nova-compute[75235]:     </interface>
Nov 29 19:09:10 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:09:10 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d/console.log" append="off"/>
Nov 29 19:09:10 user nova-compute[75235]:     </serial>
Nov 29 19:09:10 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:09:10 user nova-compute[75235]:     <video>
Nov 29 19:09:10 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:10 user nova-compute[75235]:     </video>
Nov 29 19:09:10 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:09:10 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:09:10 user nova-compute[75235]:     </rng>
Nov 29 19:09:10 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:09:10 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:09:10 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:09:10 user nova-compute[75235]:     </memballoon>
Nov 29 19:09:10 user nova-compute[75235]:   </devices>
Nov 29 19:09:10 user nova-compute[75235]: </domain>
Nov 29 19:09:10 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1104868735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1047567644',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI66VmULyd9ckKxIHCFeqsXCYg/QSiaHvW1iAxP1EMxJ/4CTxOTWXE/izpcbRPZjsIXsx+mjuN86ozzO8VxEQ8qrf2Qje0qP6MElQeVrdKCkA7YqK6sFocX0Lkbu/6+sw==',key_name='tempest-keypair-471369165',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f47892237b941b5a5c3907e0fda8833',ramdisk_id='',reservation_id='r-cq80ikws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2075615192',owner_user_name='tempest-ServerActionsV293TestJSON-2075615192-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82dcae401a574847b3262ee209963897',uuid=68da4f22-a767-4f82-a0fa-e757d8437c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converting VIF {"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d58906-1ec0-45a8-96d6-9a6a4c6a04e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:09:10 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4546ce4c-f318-5a81-85a4-3f554a594cc7', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97293492-a5, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97293492-a5, col_values=(('qos', UUID('a9b48709-8274-47fc-a77f-f9778bed9584')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97293492-a5, col_values=(('external_ids', {'iface-id': '97293492-a506-48cb-aa5a-2cba15a33988', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:6e:e4', 'vm-uuid': '68da4f22-a767-4f82-a0fa-e757d8437c1d'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ef1b47-b182-4847-a2b8-fe95fa908f7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff] added
Nov 29 19:09:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:10 user nova-compute[75235]: INFO os_vif [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5')
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c1687-fb86-41ef-bb7b-ba548406a92f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5224c6ed-dcf3-4c66-8d13-6fee112c9e8c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYRczWra {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] No VIF found with MAC fa:16:3e:8c:6e:e4, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYRczWra" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a128b4-9c53-48b1-a111-1c757958ff0c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYRczWra'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362756b-348b-4b67-8b38-aac96573ca5b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[deefd17c-33a6-42d9-8df5-9f2148e3c464]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:10 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:10 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0267be4f-89ad-4e1a-a727-16bdee2aa825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]
Nov 29 19:09:10 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.
Nov 29 19:09:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bb0c3e-391f-49b2-bf60-242e0a8c2116]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c57e0f2-dfb5-4136-9fd7-aa318ac4e769]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:10 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:10 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:10 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:10 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf19ab-9fc2-404b-83c9-390c09d92ef3]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updated VIF entry in instance network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2ecba66f-d721-40ba-b00e-9ac55bea4846 req-81f16f29-5567-4b20-a0ec-a1ec46392e4d service nova] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:10 user nova-compute[75235]: INFO nova.compute.manager [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attaching volume 1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 to /dev/vdb
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.utils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285d16e-5b07-4b0b-85ce-8de5f4840167]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca2a27-d8ca-4e79-b172-d3836e0a766d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e66d4-efa4-4076-8237-85ca265fc7e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6c451-37f4-4348-bdc9-e69a43475e50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:10 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:09:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd1f68-ed14-4ede-a15b-91bf19df6d1c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG os_brick.utils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:10 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updating existing volume attachment record: 98e50d45-dcc0-4892-b7db-22a7ad8b2e72 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23037303161643931', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037303161643931', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1990269533',display_name='tempest-TestShelveInstance-server-1990269533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1990269533',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1055985921',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bbb3eff325cd4b08bb2b3a3a1545433f',ramdisk_id='',reservation_id='r-s0b0nq41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1781237838',owner_user_name='tempest-TestShelveInstance-1781237838-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:09:00Z,user_data=None,user_id='d3da1a3f4fe44a6b8d177891669e67bc',uuid=03f7d056-56b5-45ba-a6e1-3449e35b9728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converting VIF {"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.objects.base [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Object Instance<03f7d056-56b5-45ba-a6e1-3449e35b9728> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:09:11 user nova-compute[75235]:   <uuid>03f7d056-56b5-45ba-a6e1-3449e35b9728</uuid>
Nov 29 19:09:11 user nova-compute[75235]:   <name>instance-00000010</name>
Nov 29 19:09:11 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:09:11 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:09:11 user nova-compute[75235]:   <metadata>
Nov 29 19:09:11 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:09:11 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:09:11 user nova-compute[75235]:       <nova:name>tempest-TestShelveInstance-server-1990269533</nova:name>
Nov 29 19:09:11 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:09:10</nova:creationTime>
Nov 29 19:09:11 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:09:11 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:09:11 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:09:11 user nova-compute[75235]:       <nova:owner>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:user uuid="d3da1a3f4fe44a6b8d177891669e67bc">tempest-TestShelveInstance-1781237838-project-member</nova:user>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:project uuid="bbb3eff325cd4b08bb2b3a3a1545433f">tempest-TestShelveInstance-1781237838</nova:project>
Nov 29 19:09:11 user nova-compute[75235]:       </nova:owner>
Nov 29 19:09:11 user nova-compute[75235]:       <nova:ports>
Nov 29 19:09:11 user nova-compute[75235]:         <nova:port uuid="bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc">
Nov 29 19:09:11 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 19:09:11 user nova-compute[75235]:         </nova:port>
Nov 29 19:09:11 user nova-compute[75235]:       </nova:ports>
Nov 29 19:09:11 user nova-compute[75235]:     </nova:instance>
Nov 29 19:09:11 user nova-compute[75235]:   </metadata>
Nov 29 19:09:11 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:09:11 user nova-compute[75235]:     <system>
Nov 29 19:09:11 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:09:11 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:09:11 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:09:11 user nova-compute[75235]:       <entry name="serial">03f7d056-56b5-45ba-a6e1-3449e35b9728</entry>
Nov 29 19:09:11 user nova-compute[75235]:       <entry name="uuid">03f7d056-56b5-45ba-a6e1-3449e35b9728</entry>
Nov 29 19:09:11 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:09:11 user nova-compute[75235]:     </system>
Nov 29 19:09:11 user nova-compute[75235]:   </sysinfo>
Nov 29 19:09:11 user nova-compute[75235]:   <os>
Nov 29 19:09:11 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:09:11 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:09:11 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:09:11 user nova-compute[75235]:   </os>
Nov 29 19:09:11 user nova-compute[75235]:   <features>
Nov 29 19:09:11 user nova-compute[75235]:     <acpi/>
Nov 29 19:09:11 user nova-compute[75235]:     <apic/>
Nov 29 19:09:11 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:09:11 user nova-compute[75235]:   </features>
Nov 29 19:09:11 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:09:11 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:09:11 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:09:11 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:09:11 user nova-compute[75235]:   </clock>
Nov 29 19:09:11 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:09:11 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:09:11 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:09:11 user nova-compute[75235]:   </cpu>
Nov 29 19:09:11 user nova-compute[75235]:   <devices>
Nov 29 19:09:11 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:09:11 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:11 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:09:11 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:09:11 user nova-compute[75235]:       <serial>5c384bd6-f224-4711-aa47-ee9a16ca9bff</serial>
Nov 29 19:09:11 user nova-compute[75235]:     </disk>
Nov 29 19:09:11 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:09:11 user nova-compute[75235]:       <mac address="fa:16:3e:d9:76:ef"/>
Nov 29 19:09:11 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:11 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:09:11 user nova-compute[75235]:       <target dev="tapbbdd8a68-f5"/>
Nov 29 19:09:11 user nova-compute[75235]:     </interface>
Nov 29 19:09:11 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:09:11 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728/console.log" append="off"/>
Nov 29 19:09:11 user nova-compute[75235]:     </serial>
Nov 29 19:09:11 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:09:11 user nova-compute[75235]:     <video>
Nov 29 19:09:11 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:11 user nova-compute[75235]:     </video>
Nov 29 19:09:11 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:09:11 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:09:11 user nova-compute[75235]:     </rng>
Nov 29 19:09:11 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:09:11 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:09:11 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:09:11 user nova-compute[75235]:     </memballoon>
Nov 29 19:09:11 user nova-compute[75235]:   </devices>
Nov 29 19:09:11 user nova-compute[75235]: </domain>
Nov 29 19:09:11 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1990269533',display_name='tempest-TestShelveInstance-server-1990269533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1990269533',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1055985921',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bbb3eff325cd4b08bb2b3a3a1545433f',ramdisk_id='',reservation_id='r-s0b0nq41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1781237838',owner_user_name='tempest-TestShelveInstance-1781237838-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:09:00Z,user_data=None,user_id='d3da1a3f4fe44a6b8d177891669e67bc',uuid=03f7d056-56b5-45ba-a6e1-3449e35b9728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converting VIF {"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG os_vif [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1f04526-96ab-5e43-8985-1b41448c7044', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbdd8a68-f5, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbdd8a68-f5, col_values=(('qos', UUID('56db6120-b795-46f2-8f41-7e96061014b4')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbdd8a68-f5, col_values=(('external_ids', {'iface-id': 'bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:76:ef', 'vm-uuid': '03f7d056-56b5-45ba-a6e1-3449e35b9728'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:11 user nova-compute[75235]: INFO os_vif [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5')
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] No VIF found with MAC fa:16:3e:d9:76:ef, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-3494afff-50a1-445c-adf8-d318c5e2e2b4 req-a7f9a00f-59c1-4e20-bb2a-7b9968e985d2 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3494afff-50a1-445c-adf8-d318c5e2e2b4 req-a7f9a00f-59c1-4e20-bb2a-7b9968e985d2 service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3494afff-50a1-445c-adf8-d318c5e2e2b4 req-a7f9a00f-59c1-4e20-bb2a-7b9968e985d2 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3494afff-50a1-445c-adf8-d318c5e2e2b4 req-a7f9a00f-59c1-4e20-bb2a-7b9968e985d2 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-3494afff-50a1-445c-adf8-d318c5e2e2b4 req-a7f9a00f-59c1-4e20-bb2a-7b9968e985d2 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:11 user nova-compute[75235]: WARNING nova.compute.manager [req-3494afff-50a1-445c-adf8-d318c5e2e2b4 req-a7f9a00f-59c1-4e20-bb2a-7b9968e985d2 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 19:09:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-9f1d1842-24e6-4b97-bc8a-27ae29d83aea req-8510091a-e3e6-445c-84f5-f1b690450511 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9f1d1842-24e6-4b97-bc8a-27ae29d83aea req-8510091a-e3e6-445c-84f5-f1b690450511 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9f1d1842-24e6-4b97-bc8a-27ae29d83aea req-8510091a-e3e6-445c-84f5-f1b690450511 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9f1d1842-24e6-4b97-bc8a-27ae29d83aea req-8510091a-e3e6-445c-84f5-f1b690450511 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-9f1d1842-24e6-4b97-bc8a-27ae29d83aea req-8510091a-e3e6-445c-84f5-f1b690450511 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:13 user nova-compute[75235]: WARNING nova.compute.manager [req-9f1d1842-24e6-4b97-bc8a-27ae29d83aea req-8510091a-e3e6-445c-84f5-f1b690450511 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4d704fc-7470-4b94-b5de-eabb250d0333 req-60a1cd6b-c014-4a88-8620-685457ca6ecb service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4d704fc-7470-4b94-b5de-eabb250d0333 req-60a1cd6b-c014-4a88-8620-685457ca6ecb service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4d704fc-7470-4b94-b5de-eabb250d0333 req-60a1cd6b-c014-4a88-8620-685457ca6ecb service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4d704fc-7470-4b94-b5de-eabb250d0333 req-60a1cd6b-c014-4a88-8620-685457ca6ecb service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4d704fc-7470-4b94-b5de-eabb250d0333 req-60a1cd6b-c014-4a88-8620-685457ca6ecb service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:13 user nova-compute[75235]: WARNING nova.compute.manager [req-d4d704fc-7470-4b94-b5de-eabb250d0333 req-60a1cd6b-c014-4a88-8620-685457ca6ecb service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 19:09:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:09:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance spawned successfully.
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75235) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4803f94b-3987-4b23-87bf-350ce8cdaf39 tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.120s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-f884db88-e8f0-4246-996b-d35ff7e52acb req-885b5305-8416-441d-a8bf-f5e75e646f22 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f884db88-e8f0-4246-996b-d35ff7e52acb req-885b5305-8416-441d-a8bf-f5e75e646f22 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f884db88-e8f0-4246-996b-d35ff7e52acb req-885b5305-8416-441d-a8bf-f5e75e646f22 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f884db88-e8f0-4246-996b-d35ff7e52acb req-885b5305-8416-441d-a8bf-f5e75e646f22 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-f884db88-e8f0-4246-996b-d35ff7e52acb req-885b5305-8416-441d-a8bf-f5e75e646f22 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:15 user nova-compute[75235]: WARNING nova.compute.manager [req-f884db88-e8f0-4246-996b-d35ff7e52acb req-885b5305-8416-441d-a8bf-f5e75e646f22 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:09:15 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance spawned successfully.
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:15 user nova-compute[75235]: INFO nova.compute.manager [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Terminating instance
Nov 29 19:09:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-59835ddb-ac27-4149-8467-e9f52c8a3338 tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.852s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-3380b309-7733-4e7a-9a06-6bdaf36be34c req-a54b5936-b5a7-4da6-a25b-aee13e78a09a service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-vif-unplugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3380b309-7733-4e7a-9a06-6bdaf36be34c req-a54b5936-b5a7-4da6-a25b-aee13e78a09a service nova] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3380b309-7733-4e7a-9a06-6bdaf36be34c req-a54b5936-b5a7-4da6-a25b-aee13e78a09a service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3380b309-7733-4e7a-9a06-6bdaf36be34c req-a54b5936-b5a7-4da6-a25b-aee13e78a09a service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-3380b309-7733-4e7a-9a06-6bdaf36be34c req-a54b5936-b5a7-4da6-a25b-aee13e78a09a service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] No waiting events found dispatching network-vif-unplugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-3380b309-7733-4e7a-9a06-6bdaf36be34c req-a54b5936-b5a7-4da6-a25b-aee13e78a09a service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-vif-unplugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:09:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Instance destroyed successfully.
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lazy-loading 'resources' on Instance uuid a9079b5c-d793-44b8-b8ef-c326b5082018 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1633247778',display_name='tempest-VolumesActionsTest-instance-1633247778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1633247778',id=23,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8daa1f254776450186b9239a565ecd30',ramdisk_id='',reservation_id='r-452y5m54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-426343452',owner_user_name='tempest-VolumesActionsTest-426343452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:07:32Z,user_data=None,user_id='0f245202e6044bcdb5ce590c3d106bb2',uuid=a9079b5c-d793-44b8-b8ef-c326b5082018,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converting VIF {"id": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "address": "fa:16:3e:db:00:8b", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3c1dd41-db", "ovs_interfaceid": "e3c1dd41-db96-42b6-8f62-a0e68d321399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG os_vif [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3c1dd41-db, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e8c7ebf-c93f-4d73-9025-47fd3ac647f3) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:16 user nova-compute[75235]: INFO os_vif [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:00:8b,bridge_name='br-int',has_traffic_filtering=True,id=e3c1dd41-db96-42b6-8f62-a0e68d321399,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3c1dd41-db')
Nov 29 19:09:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Deleting instance files /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018_del
Nov 29 19:09:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Deletion of /opt/stack/data/nova/instances/a9079b5c-d793-44b8-b8ef-c326b5082018_del complete
Nov 29 19:09:16 user nova-compute[75235]: INFO nova.compute.manager [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 19:09:16 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:09:16 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:09:17 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:18 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Took 1.52 seconds to deallocate network for instance.
Nov 29 19:09:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] Acquiring lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] No waiting events found dispatching network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:18 user nova-compute[75235]: WARNING nova.compute.manager [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received unexpected event network-vif-plugged-e3c1dd41-db96-42b6-8f62-a0e68d321399 for instance with vm_state active and task_state deleting.
Nov 29 19:09:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-28795b68-3880-49be-bb88-4e049cf43e67 req-3112b32b-3e3f-46bf-a4fa-39a9292ef00c service nova] [instance: a9079b5c-d793-44b8-b8ef-c326b5082018] Received event network-vif-deleted-e3c1dd41-db96-42b6-8f62-a0e68d321399 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:18 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Deleted allocations for instance a9079b5c-d793-44b8-b8ef-c326b5082018
Nov 29 19:09:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-15d26961-89d8-4c1a-b61b-58d57e3264e5 tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "a9079b5c-d793-44b8-b8ef-c326b5082018" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.308s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBFodOrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:19 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:19 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:19 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367114f-8bdc-447c-bb1d-b4a08099f815]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:09:19 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[400301ab-ed21-4229-a3de-54fff8e610ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5] added
Nov 29 19:09:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[095dac04-a079-44b9-8b50-57b1a45d300e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d11fe5-78a7-4387-9858-30b0777f82a1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBFodOrT {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBFodOrT" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa83dc9-c739-43dc-8cfa-547b0eca947d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VBFodOrT'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbfab50-0795-47ba-bda8-f760c713d6f2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdfd645-d4a2-4eee-993d-4ee8021c6fdf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:19 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:19 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:19 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:19 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5468f4-4ae3-4bc0-b40a-736fd5d19915]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260]
Nov 29 19:09:20 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260] successful.
Nov 29 19:09:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[21147f05-15e6-474c-860a-55a9b4be700f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84a396-79d8-499a-976d-c3363eddf9f9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:20 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:20 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:20 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:09:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:20 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:20 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:20 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:09:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33cf42a-5d42-45a7-adf1-4691c650688a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBFodOrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26535386133346338', 'path': '/dev/sde'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386133346338', 'path': '/dev/sde'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:09:21 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:21 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:09:21 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:09:21 user nova-compute[75235]:   <serial>1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5</serial>
Nov 29 19:09:21 user nova-compute[75235]: </disk>
Nov 29 19:09:21 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No VIF found with MAC fa:16:3e:20:8c:8f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2e4b6d3b-4dde-4aaa-afac-899b06ec2725 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.352s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:25 user nova-compute[75235]: INFO nova.compute.manager [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attaching volume 3ebd34dd-794d-4941-ac2b-35e6e017d6d8 to /dev/vdc
Nov 29 19:09:25 user nova-compute[75235]: DEBUG os_brick.utils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd753946-4daa-4e0f-9c91-0bebcc4e83ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1f1867-2843-4e3b-8a27-2144ee92a43a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac49c6c0-ce5f-45d1-a14b-9f5e38a727fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[00496f36-cfc9-4e30-af96-9bfa57cfff0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:25 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:09:25 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[976903cd-a1b5-4d29-901f-36640daeed38]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG os_brick.utils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:25 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updating existing volume attachment record: dc2d6ae7-8c21-4817-8f32-82508814e0a4 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:09:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:33 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:09:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:33 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:09:33 user nova-compute[75235]: INFO nova.compute.claims [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Claim successful on node user
Nov 29 19:09:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:09:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.policy [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b09701817c0147aca7432e1329b82300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e6e9f44ec4c76b5c8f8f29c7e651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:09:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Creating image(s)
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "c0628a53-2856-47c2-8b64-651c656f9d93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk 1073741824" returned: 0 in 0.052s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:09:35 user nova-compute[75235]: INFO nova.compute.claims [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Claim successful on node user
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Successfully created port: 85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.210s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilpdDPyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:35 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:35 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:35 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbde5196-1e43-40cf-9276-a44b8be48164]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:09:35 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfe495a-3759-4bc1-ab2d-a832511df9e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8] added
Nov 29 19:09:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Cannot resize image /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Ensure instance console log exists: /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6add96e-0d90-4b53-92cb-1459108dc5b5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679c7b9-be2a-4f0f-8551-9609621c3191]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilpdDPyR {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ilpdDPyR" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[977782df-564a-4b2e-9333-fcd34b73f057]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ilpdDPyR'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c08e3-136a-4d54-b2a9-d84f20efc848]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93b796c-37f5-4c38-8b53-ef6c8baedf50]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb60191-eb6e-48a4-a2eb-f96e02747bad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260]
Nov 29 19:09:35 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260] successful.
Nov 29 19:09:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c383e-8f00-4ed8-be11-f9297b4286a1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35d270d-1918-4ea4-885e-96d03210f09f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:09:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:09:35 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8547be5-aacb-49c3-b0bc-0a19ba6de765]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilpdDPyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.policy [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b09701817c0147aca7432e1329b82300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e6e9f44ec4c76b5c8f8f29c7e651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:09:35 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Creating image(s)
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Successfully updated port: 85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.221s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-changed-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Refreshing instance network info cache due to event network-changed-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] Acquiring lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.253s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Successfully created port: b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk 1073741824" returned: 0 in 0.086s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance network_info: |[{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] Acquired lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.neutron [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Refreshing network info cache for port 85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Start _get_guest_xml network_info=[{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:09:36 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:36 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.233s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26431643033303832', 'path': '/dev/sdf'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431643033303832', 'path': '/dev/sdf'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977206923',display_name='tempest-ServerRescueNegativeTestJSON-server-977206923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977206923',id=25,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-chnpghcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:34Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=5380cf96-db98-487d-a6b5-bec6948e12a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'pci_devices' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:09:36 user nova-compute[75235]:   <uuid>5380cf96-db98-487d-a6b5-bec6948e12a9</uuid>
Nov 29 19:09:36 user nova-compute[75235]:   <name>instance-00000019</name>
Nov 29 19:09:36 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:09:36 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:09:36 user nova-compute[75235]:   <metadata>
Nov 29 19:09:36 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:09:36 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:09:36 user nova-compute[75235]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-977206923</nova:name>
Nov 29 19:09:36 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:09:36</nova:creationTime>
Nov 29 19:09:36 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:09:36 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:09:36 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:09:36 user nova-compute[75235]:       <nova:owner>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:user uuid="b09701817c0147aca7432e1329b82300">tempest-ServerRescueNegativeTestJSON-1726326315-project-member</nova:user>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:project uuid="a77e6e9f44ec4c76b5c8f8f29c7e651f">tempest-ServerRescueNegativeTestJSON-1726326315</nova:project>
Nov 29 19:09:36 user nova-compute[75235]:       </nova:owner>
Nov 29 19:09:36 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:09:36 user nova-compute[75235]:       <nova:ports>
Nov 29 19:09:36 user nova-compute[75235]:         <nova:port uuid="85fc5c4f-5bbb-4434-938a-560ee6fd2aaa">
Nov 29 19:09:36 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:09:36 user nova-compute[75235]:         </nova:port>
Nov 29 19:09:36 user nova-compute[75235]:       </nova:ports>
Nov 29 19:09:36 user nova-compute[75235]:     </nova:instance>
Nov 29 19:09:36 user nova-compute[75235]:   </metadata>
Nov 29 19:09:36 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:09:36 user nova-compute[75235]:     <system>
Nov 29 19:09:36 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:09:36 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:09:36 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:09:36 user nova-compute[75235]:       <entry name="serial">5380cf96-db98-487d-a6b5-bec6948e12a9</entry>
Nov 29 19:09:36 user nova-compute[75235]:       <entry name="uuid">5380cf96-db98-487d-a6b5-bec6948e12a9</entry>
Nov 29 19:09:36 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:09:36 user nova-compute[75235]:     </system>
Nov 29 19:09:36 user nova-compute[75235]:   </sysinfo>
Nov 29 19:09:36 user nova-compute[75235]:   <os>
Nov 29 19:09:36 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:09:36 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:09:36 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:09:36 user nova-compute[75235]:   </os>
Nov 29 19:09:36 user nova-compute[75235]:   <features>
Nov 29 19:09:36 user nova-compute[75235]:     <acpi/>
Nov 29 19:09:36 user nova-compute[75235]:     <apic/>
Nov 29 19:09:36 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:09:36 user nova-compute[75235]:   </features>
Nov 29 19:09:36 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:09:36 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:09:36 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:09:36 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:09:36 user nova-compute[75235]:   </clock>
Nov 29 19:09:36 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:09:36 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:09:36 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:09:36 user nova-compute[75235]:   </cpu>
Nov 29 19:09:36 user nova-compute[75235]:   <devices>
Nov 29 19:09:36 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:09:36 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:09:36 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk"/>
Nov 29 19:09:36 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:09:36 user nova-compute[75235]:     </disk>
Nov 29 19:09:36 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:09:36 user nova-compute[75235]:       <mac address="fa:16:3e:5d:71:d0"/>
Nov 29 19:09:36 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:36 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:09:36 user nova-compute[75235]:       <target dev="tap85fc5c4f-5b"/>
Nov 29 19:09:36 user nova-compute[75235]:     </interface>
Nov 29 19:09:36 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:09:36 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/console.log" append="off"/>
Nov 29 19:09:36 user nova-compute[75235]:     </serial>
Nov 29 19:09:36 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:09:36 user nova-compute[75235]:     <video>
Nov 29 19:09:36 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:36 user nova-compute[75235]:     </video>
Nov 29 19:09:36 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:09:36 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:09:36 user nova-compute[75235]:     </rng>
Nov 29 19:09:36 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:09:36 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:09:36 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:09:36 user nova-compute[75235]:     </memballoon>
Nov 29 19:09:36 user nova-compute[75235]:   </devices>
Nov 29 19:09:36 user nova-compute[75235]: </domain>
Nov 29 19:09:36 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977206923',display_name='tempest-ServerRescueNegativeTestJSON-server-977206923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977206923',id=25,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-chnpghcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:34Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=5380cf96-db98-487d-a6b5-bec6948e12a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG os_vif [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '445bd100-9111-5a5f-b42c-3bea0f7829a0', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:09:37 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:37 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:09:37 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:09:37 user nova-compute[75235]:   <serial>3ebd34dd-794d-4941-ac2b-35e6e017d6d8</serial>
Nov 29 19:09:37 user nova-compute[75235]: </disk>
Nov 29 19:09:37 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Cannot resize image /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Ensure instance console log exists: /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85fc5c4f-5b, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85fc5c4f-5b, col_values=(('qos', UUID('535cbff5-a9cc-4fd6-a409-853fdf0b8b96')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85fc5c4f-5b, col_values=(('external_ids', {'iface-id': '85fc5c4f-5bbb-4434-938a-560ee6fd2aaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:71:d0', 'vm-uuid': '5380cf96-db98-487d-a6b5-bec6948e12a9'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:37 user nova-compute[75235]: INFO os_vif [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b')
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:5d:71:d0, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updated VIF entry in instance network info cache for port 85fc5c4f-5bbb-4434-938a-560ee6fd2aaa. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-83647f01-aeed-481e-b2df-fae7a5682fc7 req-97fdc669-5f37-4b6f-b0da-d31e199d0ba0 service nova] Releasing lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] No VIF found with MAC fa:16:3e:20:8c:8f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Successfully updated port: b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f8b43e7e-440b-4a32-a33a-16f13c275a68 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.201s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-changed-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Refreshing instance network info cache due to event network-changed-b2361512-bf5c-4207-b459-21548580307c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] Acquiring lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:37 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updating instance_info_cache with network_info: [{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance network_info: |[{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] Acquired lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Refreshing network info cache for port b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Start _get_guest_xml network_info=[{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:09:38 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:38 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1713780664',display_name='tempest-ServerRescueNegativeTestJSON-server-1713780664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1713780664',id=26,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-4r2ixeg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:36Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=c0628a53-2856-47c2-8b64-651c656f9d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.objects.instance [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'pci_devices' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:09:38 user nova-compute[75235]:   <uuid>c0628a53-2856-47c2-8b64-651c656f9d93</uuid>
Nov 29 19:09:38 user nova-compute[75235]:   <name>instance-0000001a</name>
Nov 29 19:09:38 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:09:38 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:09:38 user nova-compute[75235]:   <metadata>
Nov 29 19:09:38 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:09:38 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:09:38 user nova-compute[75235]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1713780664</nova:name>
Nov 29 19:09:38 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:09:38</nova:creationTime>
Nov 29 19:09:38 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:09:38 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:09:38 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:09:38 user nova-compute[75235]:       <nova:owner>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:user uuid="b09701817c0147aca7432e1329b82300">tempest-ServerRescueNegativeTestJSON-1726326315-project-member</nova:user>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:project uuid="a77e6e9f44ec4c76b5c8f8f29c7e651f">tempest-ServerRescueNegativeTestJSON-1726326315</nova:project>
Nov 29 19:09:38 user nova-compute[75235]:       </nova:owner>
Nov 29 19:09:38 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:09:38 user nova-compute[75235]:       <nova:ports>
Nov 29 19:09:38 user nova-compute[75235]:         <nova:port uuid="b2361512-bf5c-4207-b459-21548580307c">
Nov 29 19:09:38 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 19:09:38 user nova-compute[75235]:         </nova:port>
Nov 29 19:09:38 user nova-compute[75235]:       </nova:ports>
Nov 29 19:09:38 user nova-compute[75235]:     </nova:instance>
Nov 29 19:09:38 user nova-compute[75235]:   </metadata>
Nov 29 19:09:38 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:09:38 user nova-compute[75235]:     <system>
Nov 29 19:09:38 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:09:38 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:09:38 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:09:38 user nova-compute[75235]:       <entry name="serial">c0628a53-2856-47c2-8b64-651c656f9d93</entry>
Nov 29 19:09:38 user nova-compute[75235]:       <entry name="uuid">c0628a53-2856-47c2-8b64-651c656f9d93</entry>
Nov 29 19:09:38 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:09:38 user nova-compute[75235]:     </system>
Nov 29 19:09:38 user nova-compute[75235]:   </sysinfo>
Nov 29 19:09:38 user nova-compute[75235]:   <os>
Nov 29 19:09:38 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:09:38 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:09:38 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:09:38 user nova-compute[75235]:   </os>
Nov 29 19:09:38 user nova-compute[75235]:   <features>
Nov 29 19:09:38 user nova-compute[75235]:     <acpi/>
Nov 29 19:09:38 user nova-compute[75235]:     <apic/>
Nov 29 19:09:38 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:09:38 user nova-compute[75235]:   </features>
Nov 29 19:09:38 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:09:38 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:09:38 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:09:38 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:09:38 user nova-compute[75235]:   </clock>
Nov 29 19:09:38 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:09:38 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:09:38 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:09:38 user nova-compute[75235]:   </cpu>
Nov 29 19:09:38 user nova-compute[75235]:   <devices>
Nov 29 19:09:38 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:09:38 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:09:38 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk"/>
Nov 29 19:09:38 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:09:38 user nova-compute[75235]:     </disk>
Nov 29 19:09:38 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:09:38 user nova-compute[75235]:       <mac address="fa:16:3e:91:f4:ba"/>
Nov 29 19:09:38 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:38 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:09:38 user nova-compute[75235]:       <target dev="tapb2361512-bf"/>
Nov 29 19:09:38 user nova-compute[75235]:     </interface>
Nov 29 19:09:38 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:09:38 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/console.log" append="off"/>
Nov 29 19:09:38 user nova-compute[75235]:     </serial>
Nov 29 19:09:38 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:09:38 user nova-compute[75235]:     <video>
Nov 29 19:09:38 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:38 user nova-compute[75235]:     </video>
Nov 29 19:09:38 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:09:38 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:09:38 user nova-compute[75235]:     </rng>
Nov 29 19:09:38 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:09:38 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:09:38 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:09:38 user nova-compute[75235]:     </memballoon>
Nov 29 19:09:38 user nova-compute[75235]:   </devices>
Nov 29 19:09:38 user nova-compute[75235]: </domain>
Nov 29 19:09:38 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1713780664',display_name='tempest-ServerRescueNegativeTestJSON-server-1713780664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1713780664',id=26,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-4r2ixeg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:36Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=c0628a53-2856-47c2-8b64-651c656f9d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG os_vif [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4be19fb6-866f-557a-8ec9-47f2508d4351', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2361512-bf, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2361512-bf, col_values=(('qos', UUID('44a69973-f912-43df-b470-05a7337d5b86')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2361512-bf, col_values=(('external_ids', {'iface-id': 'b2361512-bf5c-4207-b459-21548580307c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f4:ba', 'vm-uuid': 'c0628a53-2856-47c2-8b64-651c656f9d93'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: INFO os_vif [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf')
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:91:f4:ba, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updated VIF entry in instance network info cache for port b2361512-bf5c-4207-b459-21548580307c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updating instance_info_cache with network_info: [{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6752c490-a44e-4cc6-a4e1-df4e14b77e0e req-9eec5783-8161-40de-ba0c-e01c8c9fe527 service nova] Releasing lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:39 user nova-compute[75235]: INFO nova.compute.manager [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Detaching volume 1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5
Nov 29 19:09:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:39 user nova-compute[75235]: INFO nova.virt.block_device [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attempting to driver detach volume 1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 from mountpoint /dev/vdb
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Attempting to detach device vdb from instance fd04b533-21ff-408c-9571-2a873100743e from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:09:39 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:39 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:09:39 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:09:39 user nova-compute[75235]:   <serial>1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5</serial>
Nov 29 19:09:39 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:09:39 user nova-compute[75235]: </disk>
Nov 29 19:09:39 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:09:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully detached device vdb from instance fd04b533-21ff-408c-9571-2a873100743e from the persistent domain config.
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd04b533-21ff-408c-9571-2a873100743e from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:09:39 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:39 user nova-compute[75235]:   <source dev="/dev/sde"/>
Nov 29 19:09:39 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:09:39 user nova-compute[75235]:   <serial>1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5</serial>
Nov 29 19:09:39 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:09:39 user nova-compute[75235]: </disk>
Nov 29 19:09:39 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:39 user nova-compute[75235]: WARNING nova.compute.manager [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state building and task_state spawning.
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:39 user nova-compute[75235]: WARNING nova.compute.manager [req-4b4ef028-edd7-46e7-898c-fa34c5482cc5 req-f22199b8-6aad-4c40-8593-8d175886bb03 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state building and task_state spawning.
Nov 29 19:09:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:09:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:09:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance spawned successfully.
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: INFO nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Took 8.29 seconds to spawn the instance on the hypervisor.
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:09:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance spawned successfully.
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:42 user nova-compute[75235]: INFO nova.compute.manager [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Took 9.21 seconds to build instance.
Nov 29 19:09:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c0ab32a1-a0bf-4f43-9137-f29b75e2b3bf tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.312s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:43 user nova-compute[75235]: INFO nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Took 7.06 seconds to spawn the instance on the hypervisor.
Nov 29 19:09:43 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:09:43 user nova-compute[75235]: INFO nova.compute.manager [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Took 8.01 seconds to build instance.
Nov 29 19:09:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8c22784f-2302-4e0a-936b-ce571fc72647 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "c0628a53-2856-47c2-8b64-651c656f9d93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.252s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:09:44 user nova-compute[75235]: INFO nova.compute.claims [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Claim successful on node user
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:09:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-515e6f56-0f57-49fa-b707-6c1e33ae2279 req-e39d4985-f99e-41a0-98e6-0382087a86ed service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-515e6f56-0f57-49fa-b707-6c1e33ae2279 req-e39d4985-f99e-41a0-98e6-0382087a86ed service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-515e6f56-0f57-49fa-b707-6c1e33ae2279 req-e39d4985-f99e-41a0-98e6-0382087a86ed service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-515e6f56-0f57-49fa-b707-6c1e33ae2279 req-e39d4985-f99e-41a0-98e6-0382087a86ed service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-515e6f56-0f57-49fa-b707-6c1e33ae2279 req-e39d4985-f99e-41a0-98e6-0382087a86ed service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:45 user nova-compute[75235]: WARNING nova.compute.manager [req-515e6f56-0f57-49fa-b707-6c1e33ae2279 req-e39d4985-f99e-41a0-98e6-0382087a86ed service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state active and task_state None.
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.policy [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b20e89d8a3f4c29a3e97aceccff1ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8731c8d62643ada4847f70bdb57d4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:09:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Creating image(s)
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "77a38ec1523d86b82cf850df3195c0ebb4473add" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "77a38ec1523d86b82cf850df3195c0ebb4473add" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.part --force-share --output=json" returned: 0 in 0.280s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG nova.virt.images [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] 28cd689c-cf20-4711-8908-bc2161826e48 was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.part /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Successfully created port: 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.part /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.converted" returned: 0 in 0.247s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "77a38ec1523d86b82cf850df3195c0ebb4473add" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.270s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "77a38ec1523d86b82cf850df3195c0ebb4473add" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "77a38ec1523d86b82cf850df3195c0ebb4473add" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Successfully updated port: 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add,backing_fmt=raw /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add,backing_fmt=raw /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk 1073741824" returned: 0 in 0.062s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "77a38ec1523d86b82cf850df3195c0ebb4473add" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:47 user nova-compute[75235]: WARNING nova.compute.manager [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state active and task_state None.
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing instance network info cache due to event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance network_info: |[{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Cannot resize image /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Ensure instance console log exists: /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Start _get_guest_xml network_info=[{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T19:09:42Z,direct_url=<?>,disk_format='qcow2',id=28cd689c-cf20-4711-8908-bc2161826e48,min_disk=0,min_ram=0,name='tempest-scenario-img--1383122093',owner='af8731c8d62643ada4847f70bdb57d4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T19:09:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '28cd689c-cf20-4711-8908-bc2161826e48'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:09:47 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:47 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T19:09:42Z,direct_url=<?>,disk_format='qcow2',id=28cd689c-cf20-4711-8908-bc2161826e48,min_disk=0,min_ram=0,name='tempest-scenario-img--1383122093',owner='af8731c8d62643ada4847f70bdb57d4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T19:09:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-944730773',display_name='tempest-TestMinimumBasicScenario-server-944730773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-944730773',id=27,image_ref='28cd689c-cf20-4711-8908-bc2161826e48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLc5L/3ikTAmF40N0kwuBkwON2gpV6ZhKtBUiyc1D29JdVe4NFAZZz01pKjdeff/HIAnbJUe2AocBXM0xF1uVOEx/RV45kJstVwP7EktflDZYhnyTAFGV5Jxpb837+Yw==',key_name='tempest-TestMinimumBasicScenario-1275015280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0s7jj5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28cd689c-cf20-4711-8908-bc2161826e48',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:45Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=7c38c492-a28b-4f1f-96f4-5e2dde6d9de2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.objects.instance [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:09:47 user nova-compute[75235]:   <uuid>7c38c492-a28b-4f1f-96f4-5e2dde6d9de2</uuid>
Nov 29 19:09:47 user nova-compute[75235]:   <name>instance-0000001b</name>
Nov 29 19:09:47 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:09:47 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:09:47 user nova-compute[75235]:   <metadata>
Nov 29 19:09:47 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:09:47 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:09:47 user nova-compute[75235]:       <nova:name>tempest-TestMinimumBasicScenario-server-944730773</nova:name>
Nov 29 19:09:47 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:09:47</nova:creationTime>
Nov 29 19:09:47 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:09:47 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:09:47 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:09:47 user nova-compute[75235]:       <nova:owner>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:user uuid="3b20e89d8a3f4c29a3e97aceccff1ac6">tempest-TestMinimumBasicScenario-937004198-project-member</nova:user>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:project uuid="af8731c8d62643ada4847f70bdb57d4e">tempest-TestMinimumBasicScenario-937004198</nova:project>
Nov 29 19:09:47 user nova-compute[75235]:       </nova:owner>
Nov 29 19:09:47 user nova-compute[75235]:       <nova:root type="image" uuid="28cd689c-cf20-4711-8908-bc2161826e48"/>
Nov 29 19:09:47 user nova-compute[75235]:       <nova:ports>
Nov 29 19:09:47 user nova-compute[75235]:         <nova:port uuid="50e951a8-6444-4285-930b-f59efb7eea7b">
Nov 29 19:09:47 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:09:47 user nova-compute[75235]:         </nova:port>
Nov 29 19:09:47 user nova-compute[75235]:       </nova:ports>
Nov 29 19:09:47 user nova-compute[75235]:     </nova:instance>
Nov 29 19:09:47 user nova-compute[75235]:   </metadata>
Nov 29 19:09:47 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:09:47 user nova-compute[75235]:     <system>
Nov 29 19:09:47 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:09:47 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:09:47 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:09:47 user nova-compute[75235]:       <entry name="serial">7c38c492-a28b-4f1f-96f4-5e2dde6d9de2</entry>
Nov 29 19:09:47 user nova-compute[75235]:       <entry name="uuid">7c38c492-a28b-4f1f-96f4-5e2dde6d9de2</entry>
Nov 29 19:09:47 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:09:47 user nova-compute[75235]:     </system>
Nov 29 19:09:47 user nova-compute[75235]:   </sysinfo>
Nov 29 19:09:47 user nova-compute[75235]:   <os>
Nov 29 19:09:47 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:09:47 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:09:47 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:09:47 user nova-compute[75235]:   </os>
Nov 29 19:09:47 user nova-compute[75235]:   <features>
Nov 29 19:09:47 user nova-compute[75235]:     <acpi/>
Nov 29 19:09:47 user nova-compute[75235]:     <apic/>
Nov 29 19:09:47 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:09:47 user nova-compute[75235]:   </features>
Nov 29 19:09:47 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:09:47 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:09:47 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:09:47 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:09:47 user nova-compute[75235]:   </clock>
Nov 29 19:09:47 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:09:47 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:09:47 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:09:47 user nova-compute[75235]:   </cpu>
Nov 29 19:09:47 user nova-compute[75235]:   <devices>
Nov 29 19:09:47 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:09:47 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:09:47 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk"/>
Nov 29 19:09:47 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:09:47 user nova-compute[75235]:     </disk>
Nov 29 19:09:47 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:09:47 user nova-compute[75235]:       <mac address="fa:16:3e:28:20:de"/>
Nov 29 19:09:47 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:47 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:09:47 user nova-compute[75235]:       <target dev="tap50e951a8-64"/>
Nov 29 19:09:47 user nova-compute[75235]:     </interface>
Nov 29 19:09:47 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:09:47 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/console.log" append="off"/>
Nov 29 19:09:47 user nova-compute[75235]:     </serial>
Nov 29 19:09:47 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:09:47 user nova-compute[75235]:     <video>
Nov 29 19:09:47 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:09:47 user nova-compute[75235]:     </video>
Nov 29 19:09:47 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:09:47 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:09:47 user nova-compute[75235]:     </rng>
Nov 29 19:09:47 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:09:47 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:09:47 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:09:47 user nova-compute[75235]:     </memballoon>
Nov 29 19:09:47 user nova-compute[75235]:   </devices>
Nov 29 19:09:47 user nova-compute[75235]: </domain>
Nov 29 19:09:47 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-944730773',display_name='tempest-TestMinimumBasicScenario-server-944730773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-944730773',id=27,image_ref='28cd689c-cf20-4711-8908-bc2161826e48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLc5L/3ikTAmF40N0kwuBkwON2gpV6ZhKtBUiyc1D29JdVe4NFAZZz01pKjdeff/HIAnbJUe2AocBXM0xF1uVOEx/RV45kJstVwP7EktflDZYhnyTAFGV5Jxpb837+Yw==',key_name='tempest-TestMinimumBasicScenario-1275015280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0s7jj5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28cd689c-cf20-4711-8908-bc2161826e48',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:45Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=7c38c492-a28b-4f1f-96f4-5e2dde6d9de2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG os_vif [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ad7676c-4fb3-5ef4-bf27-c3dad4dd1075', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50e951a8-64, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50e951a8-64, col_values=(('qos', UUID('4dd7a079-1414-4d63-b774-c93d317b6448')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50e951a8-64, col_values=(('external_ids', {'iface-id': '50e951a8-6444-4285-930b-f59efb7eea7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:20:de', 'vm-uuid': '7c38c492-a28b-4f1f-96f4-5e2dde6d9de2'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:47 user nova-compute[75235]: INFO os_vif [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64')
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:09:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No VIF found with MAC fa:16:3e:28:20:de, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:09:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updated VIF entry in instance network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:09:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3c66b19-974e-42ec-a4b2-fa5c6ef77516 req-f0da136d-a9ce-4e96-8053-a06c7a12c118 service nova] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:09:49 user nova-compute[75235]: INFO nova.compute.claims [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Claim successful on node user
Nov 29 19:09:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:09:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.policy [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c547f019112442b7ac97442ce3432365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b84f68d6c554611a982ef7326409952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:09:49 user nova-compute[75235]: INFO nova.virt.block_device [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Booting with blank volume at /dev/vda
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e836949-5a4f-4759-96a7-beb656f1f4d3 req-d87762b4-ecee-4d1b-900e-e291d3d3cc11 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e836949-5a4f-4759-96a7-beb656f1f4d3 req-d87762b4-ecee-4d1b-900e-e291d3d3cc11 service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e836949-5a4f-4759-96a7-beb656f1f4d3 req-d87762b4-ecee-4d1b-900e-e291d3d3cc11 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e836949-5a4f-4759-96a7-beb656f1f4d3 req-d87762b4-ecee-4d1b-900e-e291d3d3cc11 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e836949-5a4f-4759-96a7-beb656f1f4d3 req-d87762b4-ecee-4d1b-900e-e291d3d3cc11 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:49 user nova-compute[75235]: WARNING nova.compute.manager [req-1e836949-5a4f-4759-96a7-beb656f1f4d3 req-d87762b4-ecee-4d1b-900e-e291d3d3cc11 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state building and task_state spawning.
Nov 29 19:09:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:50 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Successfully created port: 98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Successfully updated port: 98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-changed-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Refreshing instance network info cache due to event network-changed-98e2266a-a115-4895-b4a6-d367103eed30. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] Acquiring lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance network_info: |[{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] Acquired lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.network.neutron [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Refreshing network info cache for port 98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:09:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance spawned successfully.
Nov 29 19:09:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-3e0338d3-a058-46b6-b555-c00494fce9a1 req-b402b37d-d81d-4e22-9fe9-aac8de083de8 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3e0338d3-a058-46b6-b555-c00494fce9a1 req-b402b37d-d81d-4e22-9fe9-aac8de083de8 service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3e0338d3-a058-46b6-b555-c00494fce9a1 req-b402b37d-d81d-4e22-9fe9-aac8de083de8 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3e0338d3-a058-46b6-b555-c00494fce9a1 req-b402b37d-d81d-4e22-9fe9-aac8de083de8 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-3e0338d3-a058-46b6-b555-c00494fce9a1 req-b402b37d-d81d-4e22-9fe9-aac8de083de8 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:09:52 user nova-compute[75235]: WARNING nova.compute.manager [req-3e0338d3-a058-46b6-b555-c00494fce9a1 req-b402b37d-d81d-4e22-9fe9-aac8de083de8 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state building and task_state spawning.
Nov 29 19:09:52 user nova-compute[75235]: INFO nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:52 user nova-compute[75235]: INFO nova.compute.manager [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Took 7.64 seconds to build instance.
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updated VIF entry in instance network info cache for port 98e2266a-a115-4895-b4a6-d367103eed30. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32515603-2f4b-4763-854f-641ad08dac34 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.769s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b8f1374-a5a6-4cf2-8f72-c29f6625ef6f req-a20553b5-e5eb-49e2-a0c2-885dc1852ba5 service nova] Releasing lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:54 user nova-compute[75235]: INFO nova.compute.manager [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Detaching volume 0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:09:54 user nova-compute[75235]: INFO nova.virt.block_device [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Attempting to driver detach volume 0fd14c51-11de-4f1c-b312-f13d97fbd3d1 from mountpoint /dev/vdb
Nov 29 19:09:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Attempting to detach device vdb from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:09:54 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:54 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:09:54 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:09:54 user nova-compute[75235]:   <serial>0fd14c51-11de-4f1c-b312-f13d97fbd3d1</serial>
Nov 29 19:09:54 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 19:09:54 user nova-compute[75235]: </disk>
Nov 29 19:09:54 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:09:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully detached device vdb from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 from the persistent domain config.
Nov 29 19:09:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:09:54 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:09:54 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:09:54 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:09:54 user nova-compute[75235]:   <serial>0fd14c51-11de-4f1c-b312-f13d97fbd3d1</serial>
Nov 29 19:09:54 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 19:09:54 user nova-compute[75235]: </disk>
Nov 29 19:09:54 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:09:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG os_brick.utils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[48246f3c-6f17-48e2-af7d-2b9580bc9a66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc7d1e-6b02-483c-9b72-abe08986c15a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071d3c5-cf6c-4991-9598-8486bf64e7d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713a223-3b95-4aa1-bc23-a65a400eba20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:09:55 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab96cfd-881f-4912-ae97-37615000622e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG os_brick.utils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating existing volume attachment record: 8c9d2246-6a97-4610-b3d0-94a727310183 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:09:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:09:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.318416595458984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 68da4f22-a767-4f82-a0fa-e757d8437c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance fd04b533-21ff-408c-9571-2a873100743e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 20d745cf-cd85-4943-a03e-b6f9a3e0bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 03f7d056-56b5-45ba-a6e1-3449e35b9728 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:09:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:09:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.996s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updating instance_info_cache with network_info: [{"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-8abc39f4-4d73-4a69-8acb-d87fe3871867" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:09:59 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd04b533-21ff-408c-9571-2a873100743e is timed out.
Nov 29 19:09:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully detached device vdb from instance fd04b533-21ff-408c-9571-2a873100743e from the live domain config.
Nov 29 19:09:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBFodOrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:09:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:09:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:09:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[39244676-928f-42a5-b5d7-b3bc372cd668]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:10:00 user nova-compute[75235]: No targets found.
Nov 29 19:10:00 user nova-compute[75235]: iSNS:
Nov 29 19:10:00 user nova-compute[75235]: No targets found.
Nov 29 19:10:00 user nova-compute[75235]: STATIC:
Nov 29 19:10:00 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:10:00 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:00 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:00 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8
Nov 29 19:10:00 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:00 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:00 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:10:00 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:00 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:00 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5
Nov 29 19:10:00 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:00 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:00 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:10:00 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:00 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:00 user nova-compute[75235]: FIRMWARE:
Nov 29 19:10:00 user nova-compute[75235]: No targets found.
Nov 29 19:10:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:10:00 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:10:00 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad2b81f-48a4-4510-bb3e-b61b49d96f93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6f6a5f-4b34-4481-81a4-60ab787c4156]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 (non-flash)
Nov 29 19:10:00 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c6c5480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5'): ({'sde'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Removing single pathed devices sde {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7399b68d-28f5-4d68-b01d-3b9c25267d01]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f3d733-45f4-4c2a-9555-06fb6b9616fd]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Flushing IO for device /dev/sde {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd6bdce-3c3e-4b61-a5be-cef8f21440ca]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d966ad5-c7af-4dea-b896-bc5e59fcd4e1]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e326f0d3-45e2-4042-9eea-a9628fdb00f5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b565dc8-87bc-4480-add9-168e723fe3bc]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260]
Nov 29 19:10:00 user nova-compute[75235]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:00 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b0087b3-5c6f-4e9e-9475-e659a0c7ecb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa84161-d6af-4caa-8f57-dd54707ee83b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== disconnect_volume: return (360ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:10:01 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4ea8b0c6-64f9-4ce8-bcbc-757cf09e4269 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.198s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:02 user nova-compute[75235]: INFO nova.compute.manager [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Detaching volume 3ebd34dd-794d-4941-ac2b-35e6e017d6d8
Nov 29 19:10:02 user nova-compute[75235]: INFO nova.virt.block_device [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Attempting to driver detach volume 3ebd34dd-794d-4941-ac2b-35e6e017d6d8 from mountpoint /dev/vdc
Nov 29 19:10:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Attempting to detach device vdc from instance fd04b533-21ff-408c-9571-2a873100743e from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:10:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:10:02 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:10:02 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:10:02 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:10:02 user nova-compute[75235]:   <serial>3ebd34dd-794d-4941-ac2b-35e6e017d6d8</serial>
Nov 29 19:10:02 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 19:10:02 user nova-compute[75235]: </disk>
Nov 29 19:10:02 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:10:02 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully detached device vdc from instance fd04b533-21ff-408c-9571-2a873100743e from the persistent domain config.
Nov 29 19:10:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fd04b533-21ff-408c-9571-2a873100743e from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:10:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:10:02 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:10:02 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:10:02 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:10:02 user nova-compute[75235]:   <serial>3ebd34dd-794d-4941-ac2b-35e6e017d6d8</serial>
Nov 29 19:10:02 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 19:10:02 user nova-compute[75235]: </disk>
Nov 29 19:10:02 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:10:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:10:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:10:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Creating image(s)
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Ensure instance console log exists: /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Start _get_guest_xml network_info=[{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8c9d2246-6a97-4610-b3d0-94a727310183', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b53656ac-d97b-4845-9be5-04f96f00d07e', 'attached_at': '', 'detached_at': '', 'volume_id': '747108f3-52f2-4145-a286-a99ff5c225e5', 'serial': '747108f3-52f2-4145-a286-a99ff5c225e5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:10:05 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:05 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:05 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33494e-f45b-4890-ac34-8d22aa7f7cb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:10:05 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f792a7f7-fd0b-4217-9d42-18df3baa11f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5] added
Nov 29 19:10:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ffa69-aee7-4dab-aeed-f89f21271d44]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed8ae31-4126-498c-935d-bc253a8bd3aa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzBLxwqD {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzBLxwqD" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ee188-740c-4526-8897-48ce4bd1158a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SzBLxwqD'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[801600be-a651-43e9-bdcc-ec60297139f2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec2e65-4707-451f-acb0-7bee04ff667a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41596c-dc62-4b71-8216-d710e1232a14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260]
Nov 29 19:10:05 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea9af32-314b-4b7d-85fe-f11ddcf86c27]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c93d07-3144-4b95-8b79-24ee430435ec]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a24fa8-fd85-41ba-b485-046651f37608]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:10:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23966303332663461', 'path': '/dev/sde'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966303332663461', 'path': '/dev/sde'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-270576405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-270576405',id=28,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-gl6y1qrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:50Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=b53656ac-d97b-4845-9be5-04f96f00d07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.objects.instance [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'pci_devices' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:10:06 user nova-compute[75235]:   <uuid>b53656ac-d97b-4845-9be5-04f96f00d07e</uuid>
Nov 29 19:10:06 user nova-compute[75235]:   <name>instance-0000001c</name>
Nov 29 19:10:06 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:10:06 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:10:06 user nova-compute[75235]:   <metadata>
Nov 29 19:10:06 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:10:06 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:10:06 user nova-compute[75235]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-270576405</nova:name>
Nov 29 19:10:06 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:10:05</nova:creationTime>
Nov 29 19:10:06 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:10:06 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:10:06 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:10:06 user nova-compute[75235]:       <nova:owner>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:user uuid="c547f019112442b7ac97442ce3432365">tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member</nova:user>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:project uuid="9b84f68d6c554611a982ef7326409952">tempest-ServerBootFromVolumeStableRescueTest-1553615524</nova:project>
Nov 29 19:10:06 user nova-compute[75235]:       </nova:owner>
Nov 29 19:10:06 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:10:06 user nova-compute[75235]:       <nova:ports>
Nov 29 19:10:06 user nova-compute[75235]:         <nova:port uuid="98e2266a-a115-4895-b4a6-d367103eed30">
Nov 29 19:10:06 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:10:06 user nova-compute[75235]:         </nova:port>
Nov 29 19:10:06 user nova-compute[75235]:       </nova:ports>
Nov 29 19:10:06 user nova-compute[75235]:     </nova:instance>
Nov 29 19:10:06 user nova-compute[75235]:   </metadata>
Nov 29 19:10:06 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:10:06 user nova-compute[75235]:     <system>
Nov 29 19:10:06 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:10:06 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:10:06 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:10:06 user nova-compute[75235]:       <entry name="serial">b53656ac-d97b-4845-9be5-04f96f00d07e</entry>
Nov 29 19:10:06 user nova-compute[75235]:       <entry name="uuid">b53656ac-d97b-4845-9be5-04f96f00d07e</entry>
Nov 29 19:10:06 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:10:06 user nova-compute[75235]:     </system>
Nov 29 19:10:06 user nova-compute[75235]:   </sysinfo>
Nov 29 19:10:06 user nova-compute[75235]:   <os>
Nov 29 19:10:06 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:10:06 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:10:06 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:10:06 user nova-compute[75235]:   </os>
Nov 29 19:10:06 user nova-compute[75235]:   <features>
Nov 29 19:10:06 user nova-compute[75235]:     <acpi/>
Nov 29 19:10:06 user nova-compute[75235]:     <apic/>
Nov 29 19:10:06 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:10:06 user nova-compute[75235]:   </features>
Nov 29 19:10:06 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:10:06 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:10:06 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:10:06 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:10:06 user nova-compute[75235]:   </clock>
Nov 29 19:10:06 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:10:06 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:10:06 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:10:06 user nova-compute[75235]:   </cpu>
Nov 29 19:10:06 user nova-compute[75235]:   <devices>
Nov 29 19:10:06 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:10:06 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:10:06 user nova-compute[75235]:       <source dev="/dev/sde"/>
Nov 29 19:10:06 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:10:06 user nova-compute[75235]:       <serial>747108f3-52f2-4145-a286-a99ff5c225e5</serial>
Nov 29 19:10:06 user nova-compute[75235]:     </disk>
Nov 29 19:10:06 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:10:06 user nova-compute[75235]:       <mac address="fa:16:3e:ce:33:3f"/>
Nov 29 19:10:06 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:10:06 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:10:06 user nova-compute[75235]:       <target dev="tap98e2266a-a1"/>
Nov 29 19:10:06 user nova-compute[75235]:     </interface>
Nov 29 19:10:06 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:10:06 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/console.log" append="off"/>
Nov 29 19:10:06 user nova-compute[75235]:     </serial>
Nov 29 19:10:06 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:10:06 user nova-compute[75235]:     <video>
Nov 29 19:10:06 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:10:06 user nova-compute[75235]:     </video>
Nov 29 19:10:06 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:10:06 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:10:06 user nova-compute[75235]:     </rng>
Nov 29 19:10:06 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:10:06 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:10:06 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:10:06 user nova-compute[75235]:     </memballoon>
Nov 29 19:10:06 user nova-compute[75235]:   </devices>
Nov 29 19:10:06 user nova-compute[75235]: </domain>
Nov 29 19:10:06 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-270576405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-270576405',id=28,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-gl6y1qrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:50Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=b53656ac-d97b-4845-9be5-04f96f00d07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG os_vif [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67210e34-07c2-525b-8dd8-13fe3406d4ba', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98e2266a-a1, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98e2266a-a1, col_values=(('qos', UUID('8b99e380-c2a3-4f98-b85f-118309d0de99')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98e2266a-a1, col_values=(('external_ids', {'iface-id': '98e2266a-a115-4895-b4a6-d367103eed30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:33:3f', 'vm-uuid': 'b53656ac-d97b-4845-9be5-04f96f00d07e'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:06 user nova-compute[75235]: INFO os_vif [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1')
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:10:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No VIF found with MAC fa:16:3e:ce:33:3f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:07 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:10:07 user nova-compute[75235]: INFO nova.compute.claims [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Claim successful on node user
Nov 29 19:10:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-13400a65-57da-4e98-8564-a160f36918e9 req-a31da7c1-93cb-4b33-9ee8-ea8d5be983d3 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13400a65-57da-4e98-8564-a160f36918e9 req-a31da7c1-93cb-4b33-9ee8-ea8d5be983d3 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13400a65-57da-4e98-8564-a160f36918e9 req-a31da7c1-93cb-4b33-9ee8-ea8d5be983d3 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13400a65-57da-4e98-8564-a160f36918e9 req-a31da7c1-93cb-4b33-9ee8-ea8d5be983d3 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-13400a65-57da-4e98-8564-a160f36918e9 req-a31da7c1-93cb-4b33-9ee8-ea8d5be983d3 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:08 user nova-compute[75235]: WARNING nova.compute.manager [req-13400a65-57da-4e98-8564-a160f36918e9 req-a31da7c1-93cb-4b33-9ee8-ea8d5be983d3 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state building and task_state spawning.
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:10:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.policy [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f245202e6044bcdb5ce590c3d106bb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8daa1f254776450186b9239a565ecd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:10:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Creating image(s)
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "/opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "/opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "/opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.197s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk 1073741824" returned: 0 in 0.048s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Successfully created port: 6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Cannot resize image /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Ensure instance console log exists: /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:10:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance spawned successfully.
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:10 user nova-compute[75235]: INFO nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Successfully updated port: 6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "refresh_cache-45b953a2-c6ba-4e24-96ea-f37a70faaf49" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquired lock "refresh_cache-45b953a2-c6ba-4e24-96ea-f37a70faaf49" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-changed-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Refreshing instance network info cache due to event network-changed-6fda01c3-ecc5-48e3-ac89-29351c70ff89. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] Acquiring lock "refresh_cache-45b953a2-c6ba-4e24-96ea-f37a70faaf49" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:10 user nova-compute[75235]: INFO nova.compute.manager [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Took 21.36 seconds to build instance.
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6f46b8af-00b0-4709-a9f5-eaaaa134af44 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.470s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Updating instance_info_cache with network_info: [{"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Releasing lock "refresh_cache-45b953a2-c6ba-4e24-96ea-f37a70faaf49" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Instance network_info: |[{"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] Acquired lock "refresh_cache-45b953a2-c6ba-4e24-96ea-f37a70faaf49" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Refreshing network info cache for port 6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Start _get_guest_xml network_info=[{"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:10:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-863396336',display_name='tempest-VolumesActionsTest-instance-863396336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-863396336',id=29,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8daa1f254776450186b9239a565ecd30',ramdisk_id='',reservation_id='r-9v8mamyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-426343452',owner_user_name='tempest-VolumesActionsTest-426343452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:10:09Z,user_data=None,user_id='0f245202e6044bcdb5ce590c3d106bb2',uuid=45b953a2-c6ba-4e24-96ea-f37a70faaf49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converting VIF {"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lazy-loading 'pci_devices' on Instance uuid 45b953a2-c6ba-4e24-96ea-f37a70faaf49 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-6bea4c55-4775-44ab-9914-db7eda62fdd6 req-294fc74a-5e28-4e49-b3db-ddb49e6d0b68 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6bea4c55-4775-44ab-9914-db7eda62fdd6 req-294fc74a-5e28-4e49-b3db-ddb49e6d0b68 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6bea4c55-4775-44ab-9914-db7eda62fdd6 req-294fc74a-5e28-4e49-b3db-ddb49e6d0b68 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6bea4c55-4775-44ab-9914-db7eda62fdd6 req-294fc74a-5e28-4e49-b3db-ddb49e6d0b68 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-6bea4c55-4775-44ab-9914-db7eda62fdd6 req-294fc74a-5e28-4e49-b3db-ddb49e6d0b68 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:10 user nova-compute[75235]: WARNING nova.compute.manager [req-6bea4c55-4775-44ab-9914-db7eda62fdd6 req-294fc74a-5e28-4e49-b3db-ddb49e6d0b68 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state None.
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:10:10 user nova-compute[75235]:   <uuid>45b953a2-c6ba-4e24-96ea-f37a70faaf49</uuid>
Nov 29 19:10:10 user nova-compute[75235]:   <name>instance-0000001d</name>
Nov 29 19:10:10 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:10:10 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:10:10 user nova-compute[75235]:   <metadata>
Nov 29 19:10:10 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:10:10 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:10:10 user nova-compute[75235]:       <nova:name>tempest-VolumesActionsTest-instance-863396336</nova:name>
Nov 29 19:10:10 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:10:10</nova:creationTime>
Nov 29 19:10:10 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:10:10 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:10:10 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:10:10 user nova-compute[75235]:       <nova:owner>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:user uuid="0f245202e6044bcdb5ce590c3d106bb2">tempest-VolumesActionsTest-426343452-project-member</nova:user>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:project uuid="8daa1f254776450186b9239a565ecd30">tempest-VolumesActionsTest-426343452</nova:project>
Nov 29 19:10:10 user nova-compute[75235]:       </nova:owner>
Nov 29 19:10:10 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:10:10 user nova-compute[75235]:       <nova:ports>
Nov 29 19:10:10 user nova-compute[75235]:         <nova:port uuid="6fda01c3-ecc5-48e3-ac89-29351c70ff89">
Nov 29 19:10:10 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 19:10:10 user nova-compute[75235]:         </nova:port>
Nov 29 19:10:10 user nova-compute[75235]:       </nova:ports>
Nov 29 19:10:10 user nova-compute[75235]:     </nova:instance>
Nov 29 19:10:10 user nova-compute[75235]:   </metadata>
Nov 29 19:10:10 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:10:10 user nova-compute[75235]:     <system>
Nov 29 19:10:10 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:10:10 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:10:10 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:10:10 user nova-compute[75235]:       <entry name="serial">45b953a2-c6ba-4e24-96ea-f37a70faaf49</entry>
Nov 29 19:10:10 user nova-compute[75235]:       <entry name="uuid">45b953a2-c6ba-4e24-96ea-f37a70faaf49</entry>
Nov 29 19:10:10 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:10:10 user nova-compute[75235]:     </system>
Nov 29 19:10:10 user nova-compute[75235]:   </sysinfo>
Nov 29 19:10:10 user nova-compute[75235]:   <os>
Nov 29 19:10:10 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:10:10 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:10:10 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:10:10 user nova-compute[75235]:   </os>
Nov 29 19:10:10 user nova-compute[75235]:   <features>
Nov 29 19:10:10 user nova-compute[75235]:     <acpi/>
Nov 29 19:10:10 user nova-compute[75235]:     <apic/>
Nov 29 19:10:10 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:10:10 user nova-compute[75235]:   </features>
Nov 29 19:10:10 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:10:10 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:10:10 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:10:10 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:10:10 user nova-compute[75235]:   </clock>
Nov 29 19:10:10 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:10:10 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:10:10 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:10:10 user nova-compute[75235]:   </cpu>
Nov 29 19:10:10 user nova-compute[75235]:   <devices>
Nov 29 19:10:10 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:10:10 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:10:10 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk"/>
Nov 29 19:10:10 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:10:10 user nova-compute[75235]:     </disk>
Nov 29 19:10:10 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:10:10 user nova-compute[75235]:       <mac address="fa:16:3e:49:65:69"/>
Nov 29 19:10:10 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:10:10 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:10:10 user nova-compute[75235]:       <target dev="tap6fda01c3-ec"/>
Nov 29 19:10:10 user nova-compute[75235]:     </interface>
Nov 29 19:10:10 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:10:10 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/console.log" append="off"/>
Nov 29 19:10:10 user nova-compute[75235]:     </serial>
Nov 29 19:10:10 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:10:10 user nova-compute[75235]:     <video>
Nov 29 19:10:10 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:10:10 user nova-compute[75235]:     </video>
Nov 29 19:10:10 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:10:10 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:10:10 user nova-compute[75235]:     </rng>
Nov 29 19:10:10 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:10:10 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:10:10 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:10:10 user nova-compute[75235]:     </memballoon>
Nov 29 19:10:10 user nova-compute[75235]:   </devices>
Nov 29 19:10:10 user nova-compute[75235]: </domain>
Nov 29 19:10:10 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-863396336',display_name='tempest-VolumesActionsTest-instance-863396336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-863396336',id=29,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8daa1f254776450186b9239a565ecd30',ramdisk_id='',reservation_id='r-9v8mamyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-426343452',owner_user_name='tempest-VolumesActionsTest-426343452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:10:09Z,user_data=None,user_id='0f245202e6044bcdb5ce590c3d106bb2',uuid=45b953a2-c6ba-4e24-96ea-f37a70faaf49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converting VIF {"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG os_vif [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d9136fd-9457-50ef-a1de-da359f2e2cb9', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fda01c3-ec, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fda01c3-ec, col_values=(('qos', UUID('8e9f328a-0e0b-4a87-8ea9-a2b53ca2fbb0')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fda01c3-ec, col_values=(('external_ids', {'iface-id': '6fda01c3-ecc5-48e3-ac89-29351c70ff89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:65:69', 'vm-uuid': '45b953a2-c6ba-4e24-96ea-f37a70faaf49'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:10 user nova-compute[75235]: INFO os_vif [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec')
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:10:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] No VIF found with MAC fa:16:3e:49:65:69, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:10:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Updated VIF entry in instance network info cache for port 6fda01c3-ecc5-48e3-ac89-29351c70ff89. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:10:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Updating instance_info_cache with network_info: [{"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-bc16ddcd-6ce3-4238-9a4e-602095202d8a req-69e86a29-cd5c-4a14-993c-1d22d92bd587 service nova] Releasing lock "refresh_cache-45b953a2-c6ba-4e24-96ea-f37a70faaf49" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fe7ac67-8a00-41c9-ba23-99932f29dccf req-9a2ea797-4e8a-47ee-94f4-6a4f8ebf96df service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fe7ac67-8a00-41c9-ba23-99932f29dccf req-9a2ea797-4e8a-47ee-94f4-6a4f8ebf96df service nova] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fe7ac67-8a00-41c9-ba23-99932f29dccf req-9a2ea797-4e8a-47ee-94f4-6a4f8ebf96df service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fe7ac67-8a00-41c9-ba23-99932f29dccf req-9a2ea797-4e8a-47ee-94f4-6a4f8ebf96df service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fe7ac67-8a00-41c9-ba23-99932f29dccf req-9a2ea797-4e8a-47ee-94f4-6a4f8ebf96df service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] No waiting events found dispatching network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:12 user nova-compute[75235]: WARNING nova.compute.manager [req-5fe7ac67-8a00-41c9-ba23-99932f29dccf req-9a2ea797-4e8a-47ee-94f4-6a4f8ebf96df service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received unexpected event network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 for instance with vm_state building and task_state spawning.
Nov 29 19:10:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-48a54208-d72f-44f1-abec-f170e0c5a06e req-04d9dab2-b44e-45ce-bfc7-4d657bc15c88 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-48a54208-d72f-44f1-abec-f170e0c5a06e req-04d9dab2-b44e-45ce-bfc7-4d657bc15c88 service nova] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-48a54208-d72f-44f1-abec-f170e0c5a06e req-04d9dab2-b44e-45ce-bfc7-4d657bc15c88 service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-48a54208-d72f-44f1-abec-f170e0c5a06e req-04d9dab2-b44e-45ce-bfc7-4d657bc15c88 service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-48a54208-d72f-44f1-abec-f170e0c5a06e req-04d9dab2-b44e-45ce-bfc7-4d657bc15c88 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] No waiting events found dispatching network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:14 user nova-compute[75235]: WARNING nova.compute.manager [req-48a54208-d72f-44f1-abec-f170e0c5a06e req-04d9dab2-b44e-45ce-bfc7-4d657bc15c88 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received unexpected event network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 for instance with vm_state building and task_state spawning.
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:10:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Instance spawned successfully.
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:10:14 user nova-compute[75235]: INFO nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 29 19:10:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:10:14 user nova-compute[75235]: INFO nova.compute.manager [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Took 6.85 seconds to build instance.
Nov 29 19:10:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ffead2d0-4e59-4678-95ae-80bb8f8d5a7c tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.983s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:15 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 is timed out.
Nov 29 19:10:15 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully detached device vdb from instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 from the live domain config.
Nov 29 19:10:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjRWmMJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:15 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b565d0c6-4875-4008-b4ab-be79c1ef9ff4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:10:15 user nova-compute[75235]: No targets found.
Nov 29 19:10:15 user nova-compute[75235]: iSNS:
Nov 29 19:10:15 user nova-compute[75235]: No targets found.
Nov 29 19:10:15 user nova-compute[75235]: STATIC:
Nov 29 19:10:15 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:10:15 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:15 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:15 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8
Nov 29 19:10:15 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:15 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:15 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:10:15 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:15 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:15 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:10:15 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:15 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:15 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1
Nov 29 19:10:15 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:15 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:15 user nova-compute[75235]: FIRMWARE:
Nov 29 19:10:15 user nova-compute[75235]: No targets found.
Nov 29 19:10:15 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:10:15 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:10:15 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a2b877-d2c1-497f-ac5c-f60916b9e45b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ba0ed-1193-4e2f-a5a0-02f1e103c4f3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:15 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:15 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:15 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5658129360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa441966-a7fd-45d4-a9c7-82547e0b5098]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[26194c70-7e09-4925-9934-f6c4eddd2eed]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c5753-aba5-4c8a-888c-63ed7819f96a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3250b9f1-3620-4976-9e99-796c9524a11a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[56731745-21ef-4e46-a4ef-c2f877355c26]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a185b1c-5850-466c-9bdf-e61120ec59bf]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260]
Nov 29 19:10:15 user nova-compute[75235]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:15 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd14c51-11de-4f1c-b312-f13d97fbd3d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f178295d-4f8b-4f2c-a527-42044cd21f2b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== disconnect_volume: return (347ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:10:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'flavor' on Instance uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3d887d55-740e-4f69-b3e6-f182dd879efe tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.966s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing instance network info cache due to event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:10:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:20 user nova-compute[75235]: DEBUG nova.network.neutron [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:10:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updated VIF entry in instance network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:10:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-52cc54dd-fa4d-4bbf-bfdc-8e49944ad787 req-6c1abf2b-49cc-4c5f-906e-4e135dad0b02 service nova] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fd04b533-21ff-408c-9571-2a873100743e is timed out.
Nov 29 19:10:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully detached device vdc from instance fd04b533-21ff-408c-9571-2a873100743e from the live domain config.
Nov 29 19:10:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ilpdDPyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:22 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ab2dd-9ea5-4c1b-908a-706f9cea405d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:10:22 user nova-compute[75235]: No targets found.
Nov 29 19:10:22 user nova-compute[75235]: iSNS:
Nov 29 19:10:22 user nova-compute[75235]: No targets found.
Nov 29 19:10:22 user nova-compute[75235]: STATIC:
Nov 29 19:10:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:10:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8
Nov 29 19:10:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:10:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:10:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:22 user nova-compute[75235]: FIRMWARE:
Nov 29 19:10:22 user nova-compute[75235]: No targets found.
Nov 29 19:10:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:10:22 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:10:22 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee4731-2754-4b42-8070-1687826a477d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fe8761-215f-4a24-b1c5-5bb45f8019a2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:22 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:22 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:22 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:22 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:22 user nova-compute[75235]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 (non-flash)
Nov 29 19:10:22 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c52b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8'): ({'sdf'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Removing single pathed devices sdf {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff9553-7b9f-48e4-897b-b9af728d62a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3c52f7-831c-454f-8206-807cd8eb5b80]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Flushing IO for device /dev/sdf {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6356550-d39b-4d50-ac20-6ccea43bb3b8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2bbd13-955e-4b2f-8bc6-f2e398baa123]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5104cbc-a5d3-4504-aa34-ece55fc88969]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f865be7-a7c5-4890-93ae-64fb8de27e29]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260]
Nov 29 19:10:22 user nova-compute[75235]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ebd34dd-794d-4941-ac2b-35e6e017d6d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253ee08-409c-4fad-9811-887d5be53af1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] <== disconnect_volume: return (346ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'flavor' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2485f9cf-aadc-4833-b8a7-1cc6bbf8f038 tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:24 user nova-compute[75235]: INFO nova.compute.manager [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Shelving
Nov 29 19:10:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3122eda-7bee-470a-933b-4fa9322f68d8 req-504c4db4-0726-4d10-b3a1-4f690858452e service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-unplugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3122eda-7bee-470a-933b-4fa9322f68d8 req-504c4db4-0726-4d10-b3a1-4f690858452e service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3122eda-7bee-470a-933b-4fa9322f68d8 req-504c4db4-0726-4d10-b3a1-4f690858452e service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3122eda-7bee-470a-933b-4fa9322f68d8 req-504c4db4-0726-4d10-b3a1-4f690858452e service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3122eda-7bee-470a-933b-4fa9322f68d8 req-504c4db4-0726-4d10-b3a1-4f690858452e service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-unplugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:24 user nova-compute[75235]: WARNING nova.compute.manager [req-b3122eda-7bee-470a-933b-4fa9322f68d8 req-504c4db4-0726-4d10-b3a1-4f690858452e service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-unplugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state active and task_state shelving.
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:25 user nova-compute[75235]: INFO nova.compute.manager [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Terminating instance
Nov 29 19:10:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:10:25 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance destroyed successfully.
Nov 29 19:10:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:25 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Beginning cold snapshot process
Nov 29 19:10:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-ef73c4c2-394e-4d48-8289-35b04d96fe91 req-00217396-b8fa-4bd9-9665-f2daa293a5ba service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-vif-unplugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ef73c4c2-394e-4d48-8289-35b04d96fe91 req-00217396-b8fa-4bd9-9665-f2daa293a5ba service nova] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ef73c4c2-394e-4d48-8289-35b04d96fe91 req-00217396-b8fa-4bd9-9665-f2daa293a5ba service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ef73c4c2-394e-4d48-8289-35b04d96fe91 req-00217396-b8fa-4bd9-9665-f2daa293a5ba service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-ef73c4c2-394e-4d48-8289-35b04d96fe91 req-00217396-b8fa-4bd9-9665-f2daa293a5ba service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] No waiting events found dispatching network-vif-unplugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-ef73c4c2-394e-4d48-8289-35b04d96fe91 req-00217396-b8fa-4bd9-9665-f2daa293a5ba service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-vif-unplugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk /opt/stack/data/nova/instances/snapshots/tmp9tqmk7zo/eb1b5044adee46cb9c5a664093f054f7 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: fd04b533-21ff-408c-9571-2a873100743e] Instance destroyed successfully.
Nov 29 19:10:26 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lazy-loading 'resources' on Instance uuid fd04b533-21ff-408c-9571-2a873100743e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-279975914',display_name='tempest-AttachVolumeTestJSON-server-279975914',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-279975914',id=22,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ065TwqxfC4oe23Nw55p8M6VcZtMZbG/UQXIMpvkDOhy7Zljp4CT0bRjn2hsysqVxnqUR6tMtY5McNOZEswqdjXwqljtmQfoe4aHvWY0Emel/w0Ph9/K8qZ331aM3CRQ==',key_name='tempest-keypair-1496592804',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f675723ce844bf5ae965d0b53ae439d',ramdisk_id='',reservation_id='r-qwpx80ai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1430085223',owner_user_name='tempest-AttachVolumeTestJSON-1430085223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e2babb226c484046aab50a159bf20ef4',uuid=fd04b533-21ff-408c-9571-2a873100743e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converting VIF {"id": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "address": "fa:16:3e:20:8c:8f", "network": {"id": "40d9e630-e67f-4acd-825b-e5071131a585", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1226635495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f675723ce844bf5ae965d0b53ae439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2ae742-6f", "ovs_interfaceid": "2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG os_vif [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c2ae742-6f, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b55c49b6-0617-407f-ac10-6f12706ec40d) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:26 user nova-compute[75235]: INFO os_vif [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:8c:8f,bridge_name='br-int',has_traffic_filtering=True,id=2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8,network=Network(40d9e630-e67f-4acd-825b-e5071131a585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2ae742-6f')
Nov 29 19:10:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Deleting instance files /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e_del
Nov 29 19:10:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Deletion of /opt/stack/data/nova/instances/fd04b533-21ff-408c-9571-2a873100743e_del complete
Nov 29 19:10:26 user nova-compute[75235]: INFO nova.compute.manager [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] [instance: fd04b533-21ff-408c-9571-2a873100743e] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 29 19:10:26 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: fd04b533-21ff-408c-9571-2a873100743e] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: fd04b533-21ff-408c-9571-2a873100743e] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:10:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk /opt/stack/data/nova/instances/snapshots/tmp9tqmk7zo/eb1b5044adee46cb9c5a664093f054f7" returned: 0 in 1.029s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Snapshot extracted, beginning image upload
Nov 29 19:10:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-a74c5aab-d0fd-4121-afe8-330034881613 req-f68e9a98-9a7f-487a-b881-139501dbdf5e service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a74c5aab-d0fd-4121-afe8-330034881613 req-f68e9a98-9a7f-487a-b881-139501dbdf5e service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a74c5aab-d0fd-4121-afe8-330034881613 req-f68e9a98-9a7f-487a-b881-139501dbdf5e service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a74c5aab-d0fd-4121-afe8-330034881613 req-f68e9a98-9a7f-487a-b881-139501dbdf5e service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-a74c5aab-d0fd-4121-afe8-330034881613 req-f68e9a98-9a7f-487a-b881-139501dbdf5e service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:27 user nova-compute[75235]: WARNING nova.compute.manager [req-a74c5aab-d0fd-4121-afe8-330034881613 req-f68e9a98-9a7f-487a-b881-139501dbdf5e service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 19:10:27 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: fd04b533-21ff-408c-9571-2a873100743e] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:27 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: fd04b533-21ff-408c-9571-2a873100743e] Took 1.01 seconds to deallocate network for instance.
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-cc4999ed-7f2d-4feb-8a42-4f0fa54f2be5 req-cee73e15-9b62-4b10-a0e9-6dddba3df615 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cc4999ed-7f2d-4feb-8a42-4f0fa54f2be5 req-cee73e15-9b62-4b10-a0e9-6dddba3df615 service nova] Acquiring lock "fd04b533-21ff-408c-9571-2a873100743e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cc4999ed-7f2d-4feb-8a42-4f0fa54f2be5 req-cee73e15-9b62-4b10-a0e9-6dddba3df615 service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cc4999ed-7f2d-4feb-8a42-4f0fa54f2be5 req-cee73e15-9b62-4b10-a0e9-6dddba3df615 service nova] Lock "fd04b533-21ff-408c-9571-2a873100743e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-cc4999ed-7f2d-4feb-8a42-4f0fa54f2be5 req-cee73e15-9b62-4b10-a0e9-6dddba3df615 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] No waiting events found dispatching network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:27 user nova-compute[75235]: WARNING nova.compute.manager [req-cc4999ed-7f2d-4feb-8a42-4f0fa54f2be5 req-cee73e15-9b62-4b10-a0e9-6dddba3df615 service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received unexpected event network-vif-plugged-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 for instance with vm_state deleted and task_state None.
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'flavor' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:28 user nova-compute[75235]: INFO nova.compute.manager [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Attaching volume c4801896-ec3b-4de0-b0e7-132535a07033 to /dev/vdb
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.618s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG os_brick.utils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:28 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Deleted allocations for instance fd04b533-21ff-408c-9571-2a873100743e
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b072775-78c6-4c12-8608-d44742e640f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[90586e94-4af6-44f6-ae8e-4090daefce1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[99df61a1-684e-41e7-8ac2-1114fdf00aca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b3d115-907d-4863-a7e5-ab325717d1f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f7be7f17-a948-41b3-87cf-defcaa2cc75d tempest-AttachVolumeTestJSON-1430085223 tempest-AttachVolumeTestJSON-1430085223-project-member] Lock "fd04b533-21ff-408c-9571-2a873100743e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.997s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:10:28 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:10:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a216aa78-65af-485d-bd63-958ff46cfb29]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG os_brick.utils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:28 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating existing volume attachment record: 865865d2-18bf-40b8-b707-a85b75f2d75f {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:10:29 user nova-compute[75235]: DEBUG nova.compute.manager [req-eb1ad942-fde9-4bdd-a73d-2d4d71095c16 req-62e37ab1-3719-4b08-8863-2594fe6e29eb service nova] [instance: fd04b533-21ff-408c-9571-2a873100743e] Received event network-vif-deleted-2c2ae742-6f2a-4e8c-ba51-598e2f0dc2f8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:29 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Snapshot image upload complete
Nov 29 19:10:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:10:29 user nova-compute[75235]: INFO nova.compute.manager [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Shelve offloading
Nov 29 19:10:29 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance destroyed successfully.
Nov 29 19:10:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:10:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:29 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:30 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance destroyed successfully.
Nov 29 19:10:30 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'resources' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:30 user nova-compute[75235]: INFO nova.compute.manager [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Terminating instance
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1625356192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1625356192',id=24,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEpJcpTjeHMDxai3qqEOAIdCA0v7Hr+RNymMwe4pAA+ygLaCmvGzLhi16aFKVACV9WcFl6xJTdZkVhdfg4rGF5Fyzwqqdu4T5Xc/1zHFL3waCjPT+Dv6CmAPn5ehWpt9A==',key_name='tempest-keypair-1274433502',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-l4j9sl90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member',shelved_at='2023-11-29T19:10:29.730612',shelved_host='user',shelved_image_id='8e1f46d6-9a0c-4695-a751-40415b26111d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=20d745cf-cd85-4943-a03e-b6f9a3e0bafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_vif [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8e45ee5-1a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07f486a1-a174-4894-93bf-a22da5306ce6) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: INFO os_vif [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a')
Nov 29 19:10:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Deleting instance files /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe_del
Nov 29 19:10:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Deletion of /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe_del complete
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing instance network info cache due to event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.neutron [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:10:31 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Deleted allocations for instance 20d745cf-cd85-4943-a03e-b6f9a3e0bafe
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'numa_topology' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.objects.base [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<20d745cf-cd85-4943-a03e-b6f9a3e0bafe> lazy-loaded attributes: resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-233544d0-ea47-4c57-a071-8ee141084f92 req-406a3c9b-dc8d-49e7-a12a-7f8787298c09 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-unplugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-233544d0-ea47-4c57-a071-8ee141084f92 req-406a3c9b-dc8d-49e7-a12a-7f8787298c09 service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-233544d0-ea47-4c57-a071-8ee141084f92 req-406a3c9b-dc8d-49e7-a12a-7f8787298c09 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-233544d0-ea47-4c57-a071-8ee141084f92 req-406a3c9b-dc8d-49e7-a12a-7f8787298c09 service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-233544d0-ea47-4c57-a071-8ee141084f92 req-406a3c9b-dc8d-49e7-a12a-7f8787298c09 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-unplugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-233544d0-ea47-4c57-a071-8ee141084f92 req-406a3c9b-dc8d-49e7-a12a-7f8787298c09 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-unplugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.neutron [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updated VIF entry in instance network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.neutron [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7ab6f8dc-35b0-4ba8-97b9-0758994c0992 req-1edfaaa9-4a41-4831-9258-06c91987a2fd service nova] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Instance destroyed successfully.
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lazy-loading 'resources' on Instance uuid 68da4f22-a767-4f82-a0fa-e757d8437c1d {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1104868735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1047567644',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKI66VmULyd9ckKxIHCFeqsXCYg/QSiaHvW1iAxP1EMxJ/4CTxOTWXE/izpcbRPZjsIXsx+mjuN86ozzO8VxEQ8qrf2Qje0qP6MElQeVrdKCkA7YqK6sFocX0Lkbu/6+sw==',key_name='tempest-keypair-471369165',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f47892237b941b5a5c3907e0fda8833',ramdisk_id='',reservation_id='r-cq80ikws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-2075615192',owner_user_name='tempest-ServerActionsV293TestJSON-2075615192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82dcae401a574847b3262ee209963897',uuid=68da4f22-a767-4f82-a0fa-e757d8437c1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converting VIF {"id": "97293492-a506-48cb-aa5a-2cba15a33988", "address": "fa:16:3e:8c:6e:e4", "network": {"id": "56ffbf44-72b9-42a1-aa24-4e43d5132231", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1032501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f47892237b941b5a5c3907e0fda8833", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97293492-a5", "ovs_interfaceid": "97293492-a506-48cb-aa5a-2cba15a33988", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_vif [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97293492-a5, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9b48709-8274-47fc-a77f-f9778bed9584) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:31 user nova-compute[75235]: INFO os_vif [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:6e:e4,bridge_name='br-int',has_traffic_filtering=True,id=97293492-a506-48cb-aa5a-2cba15a33988,network=Network(56ffbf44-72b9-42a1-aa24-4e43d5132231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97293492-a5')
Nov 29 19:10:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwnmWAhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:31 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8bea72-10d3-42d3-aff7-49b0d1a4190d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:10:31 user nova-compute[75235]: No targets found.
Nov 29 19:10:31 user nova-compute[75235]: iSNS:
Nov 29 19:10:31 user nova-compute[75235]: No targets found.
Nov 29 19:10:31 user nova-compute[75235]: STATIC:
Nov 29 19:10:31 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a
Nov 29 19:10:31 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:31 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:31 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:10:31 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:31 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:31 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:10:31 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:31 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:31 user nova-compute[75235]: FIRMWARE:
Nov 29 19:10:31 user nova-compute[75235]: No targets found.
Nov 29 19:10:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:10:31 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:10:31 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f6cb1ba-3ee6-405d-9693-2f161328bc53 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.362s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b5a65-f145-480b-9fa4-addac81caaae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077a11d-f418-4832-b61a-2a316105497e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:31 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:31 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a (non-flash)
Nov 29 19:10:31 user nova-compute[75235]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:31 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5650657520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3586631-1f50-40eb-8e42-a1c616cc6d64]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa4a4f-d150-4941-8a8b-1c99bff8af7d]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[58298ed9-b8d5-440b-b986-078afbb122ba]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d800b2d-34e0-476c-aed7-0101ce8e3eed]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d553d-4b9e-4770-81ba-d008f30ef95a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad277b-d8cd-4da9-8235-4acbb075396a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260]
Nov 29 19:10:32 user nova-compute[75235]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:32 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8693a058-3366-457b-800f-8db54e05e50a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[871eb547-5f20-4ea5-b04a-667b0c9a8c58]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] <== disconnect_volume: return (340ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:10:32 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Deleting instance files /opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d_del
Nov 29 19:10:32 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Deletion of /opt/stack/data/nova/instances/68da4f22-a767-4f82-a0fa-e757d8437c1d_del complete
Nov 29 19:10:32 user nova-compute[75235]: INFO nova.compute.manager [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 19:10:32 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:10:32 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:10:33 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:33 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Took 0.75 seconds to deallocate network for instance.
Nov 29 19:10:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-0f70386a-bfd5-4b28-baef-2fb619e20906 req-95e52f60-cd84-4786-a7ff-7fef43dad307 service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-deleted-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c722416-9afe-4594-a2ff-55073f56e784 req-bcb93ab6-2cc7-4c9e-bda8-925a41a7219b service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c722416-9afe-4594-a2ff-55073f56e784 req-bcb93ab6-2cc7-4c9e-bda8-925a41a7219b service nova] Acquiring lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c722416-9afe-4594-a2ff-55073f56e784 req-bcb93ab6-2cc7-4c9e-bda8-925a41a7219b service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c722416-9afe-4594-a2ff-55073f56e784 req-bcb93ab6-2cc7-4c9e-bda8-925a41a7219b service nova] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c722416-9afe-4594-a2ff-55073f56e784 req-bcb93ab6-2cc7-4c9e-bda8-925a41a7219b service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] No waiting events found dispatching network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:33 user nova-compute[75235]: WARNING nova.compute.manager [req-1c722416-9afe-4594-a2ff-55073f56e784 req-bcb93ab6-2cc7-4c9e-bda8-925a41a7219b service nova] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Received unexpected event network-vif-plugged-97293492-a506-48cb-aa5a-2cba15a33988 for instance with vm_state active and task_state deleting.
Nov 29 19:10:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:37 user nova-compute[75235]: INFO nova.compute.manager [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Took 4.38 seconds to detach 1 volumes for instance.
Nov 29 19:10:37 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] [instance: 68da4f22-a767-4f82-a0fa-e757d8437c1d] Deleting volume: 8693a058-3366-457b-800f-8db54e05e50a {{(pid=75235) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:37 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:37 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:37 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7260c-c88e-4856-bfe1-88daacc762cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:10:37 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b6e59b-2027-47d0-91e2-2e049f2c6e9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033] added
Nov 29 19:10:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.128s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43ac89d-fae0-4411-b7d2-2265632c3cd4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4d1b5b-866a-4cfc-b9c3-d29d572591eb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLWeznm {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLWeznm" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0900a68-6f79-499d-aede-c9586f632d29]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RiLWeznm'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65f3625-e2ca-49df-bba9-16220a1acd07]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08083ad-816a-438c-a1b9-3dd89170b025]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:37 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:37 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a685fa60-4992-4816-a106-2785474ce4bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]
Nov 29 19:10:37 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.096s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9742363-ee47-4fbd-b9e8-e618357892b6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fad8af-1068-483a-87f9-aef58115d1f8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:38 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:38 user nova-compute[75235]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:10:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:38 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:38 user nova-compute[75235]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:10:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.505s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da2838-e506-4d60-877a-0eb911a4a4d3]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.662s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:38 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Deleted allocations for instance 68da4f22-a767-4f82-a0fa-e757d8437c1d
Nov 29 19:10:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4a31625b-c540-4387-9097-e7b436f91bcb tempest-ServerActionsV293TestJSON-2075615192 tempest-ServerActionsV293TestJSON-2075615192-project-member] Lock "68da4f22-a767-4f82-a0fa-e757d8437c1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.349s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.550s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== connect_volume: return (1551ms) {'type': 'block', 'scsi_wwn': '26635353963626431', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635353963626431', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'flavor' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:10:39 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:10:39 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:10:39 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:10:39 user nova-compute[75235]:   <serial>c4801896-ec3b-4de0-b0e7-132535a07033</serial>
Nov 29 19:10:39 user nova-compute[75235]: </disk>
Nov 29 19:10:39 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No VIF found with MAC fa:16:3e:b2:6a:b3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:10:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0eb93d9d-3fdf-4d2a-9795-fa958a244ec3 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.557s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:41 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Stashing vm_state: active {{(pid=75235) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 19:10:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:10:41 user nova-compute[75235]: INFO nova.compute.claims [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Claim successful on node user
Nov 29 19:10:41 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating resource usage from migration 53c6c408-fac2-43cc-abd9-e97c057c78bb
Nov 29 19:10:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.453s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:42 user nova-compute[75235]: INFO nova.compute.manager [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Migrating
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:42 user nova-compute[75235]: INFO nova.compute.rpcapi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Starting migrate_disk_and_power_off {{(pid=75235) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-9b9a6bff-3b78-4558-8433-4ce3e6c09be9 req-54e721b5-46d2-4a02-a616-01874b8a1a7b service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9b9a6bff-3b78-4558-8433-4ce3e6c09be9 req-54e721b5-46d2-4a02-a616-01874b8a1a7b service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9b9a6bff-3b78-4558-8433-4ce3e6c09be9 req-54e721b5-46d2-4a02-a616-01874b8a1a7b service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9b9a6bff-3b78-4558-8433-4ce3e6c09be9 req-54e721b5-46d2-4a02-a616-01874b8a1a7b service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-9b9a6bff-3b78-4558-8433-4ce3e6c09be9 req-54e721b5-46d2-4a02-a616-01874b8a1a7b service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:43 user nova-compute[75235]: WARNING nova.compute.manager [req-9b9a6bff-3b78-4558-8433-4ce3e6c09be9 req-54e721b5-46d2-4a02-a616-01874b8a1a7b service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state resize_migrating.
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance destroyed successfully.
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap644e59e3-44, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c273617-22dc-4f72-9528-cfa4ab161605) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:43 user nova-compute[75235]: INFO os_vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44')
Nov 29 19:10:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:43 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[78167ed2-23b4-4087-964d-30cce0701273]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:10:43 user nova-compute[75235]: No targets found.
Nov 29 19:10:43 user nova-compute[75235]: iSNS:
Nov 29 19:10:43 user nova-compute[75235]: No targets found.
Nov 29 19:10:43 user nova-compute[75235]: STATIC:
Nov 29 19:10:43 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:10:43 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:43 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:43 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033
Nov 29 19:10:43 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:43 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:43 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:10:43 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:43 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:43 user nova-compute[75235]: FIRMWARE:
Nov 29 19:10:43 user nova-compute[75235]: No targets found.
Nov 29 19:10:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:10:43 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:10:43 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:10:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41c06c3-65d2-4aa2-af78-ef827ad48bf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e8424-47b8-43bf-a4f4-365cf273df5f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:44 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:44 user nova-compute[75235]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:10:44 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:44 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:44 user nova-compute[75235]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:10:44 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c6cfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a462e41-876f-49b6-89e0-df252d558666]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[045a6c18-3588-4d03-ab67-929aec6be248]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[22472e98-b80e-498b-9754-a34a9047feb7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742552a-d6a3-447d-9f49-78498147e744]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[454be681-7ccc-40a1-9d4a-becc375508f0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b033bc-4f8a-4ec3-a72f-24842f9d6f6b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]
Nov 29 19:10:44 user nova-compute[75235]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:44 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb040eec-5b44-495c-b9a9-9f79a8c152fc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== disconnect_volume: return (315ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3_resize/disk /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:44 user nova-compute[75235]: INFO nova.compute.manager [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Terminating instance
Nov 29 19:10:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "cp -r /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3_resize/disk /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk" returned: 0 in 0.353s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3_resize/disk.info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk.info {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "cp -r /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3_resize/disk.info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk.info" returned: 0 in 0.031s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:45 user nova-compute[75235]: WARNING nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state resize_migrating.
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:45 user nova-compute[75235]: WARNING nova.compute.manager [req-afa7d210-2790-48a7-875b-3b09699913ff req-85c56ffa-c6aa-477b-841c-23c378c1e969 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state active and task_state deleting.
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Instance destroyed successfully.
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.objects.instance [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'resources' on Instance uuid 0e7eb484-033e-4a7a-a259-a183e78a6b96 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-452764783',display_name='tempest-ServerActionsTestOtherA-server-2138617368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-452764783',id=15,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhlCj/4Wb1/znNidthF7GTl7ZFQnQRIHHkVL4+OP2nWB9AGzxFnIF1SOQbUUzDG+crOoTUDPSmrLhE0Rk3obbMmRv6oSwbsUt4imU4nZnxpr11Me+oK5jggNMnTB7aikA==',key_name='tempest-keypair-1677183937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:07:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-qxoxu2ui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=0e7eb484-033e-4a7a-a259-a183e78a6b96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "address": "fa:16:3e:cd:47:86", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8907cc3-5f", "ovs_interfaceid": "f8907cc3-5fa0-46bf-860f-250eaa8181e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG os_vif [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8907cc3-5f, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa66142c-3523-4987-9f65-69028de0e1b5) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:45 user nova-compute[75235]: INFO os_vif [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:47:86,bridge_name='br-int',has_traffic_filtering=True,id=f8907cc3-5fa0-46bf-860f-250eaa8181e8,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8907cc3-5f')
Nov 29 19:10:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Deleting instance files /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96_del
Nov 29 19:10:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Deletion of /opt/stack/data/nova/instances/0e7eb484-033e-4a7a-a259-a183e78a6b96_del complete
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:45 user nova-compute[75235]: INFO nova.compute.manager [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 19:10:45 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:10:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:46 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-c5564bd8-40aa-46c5-8848-e9e75bfb93a0 req-df8558db-cf7e-49a1-bea5-c1591cce0d8b service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-deleted-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:46 user nova-compute[75235]: INFO nova.compute.manager [req-c5564bd8-40aa-46c5-8848-e9e75bfb93a0 req-df8558db-cf7e-49a1-bea5-c1591cce0d8b service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Neutron deleted interface f8907cc3-5fa0-46bf-860f-250eaa8181e8; detaching it from the instance and deleting it from the info cache
Nov 29 19:10:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-c5564bd8-40aa-46c5-8848-e9e75bfb93a0 req-df8558db-cf7e-49a1-bea5-c1591cce0d8b service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:46 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Took 1.04 seconds to deallocate network for instance.
Nov 29 19:10:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-c5564bd8-40aa-46c5-8848-e9e75bfb93a0 req-df8558db-cf7e-49a1-bea5-c1591cce0d8b service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Detach interface failed, port_id=f8907cc3-5fa0-46bf-860f-250eaa8181e8, reason: Instance 0e7eb484-033e-4a7a-a259-a183e78a6b96 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:10:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Port 644e59e3-44e4-43e5-8d47-a226b1457182 binding to destination host user is already ACTIVE {{(pid=75235) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Deleted allocations for instance 0e7eb484-033e-4a7a-a259-a183e78a6b96
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-49ca2080-9e5d-4754-8aeb-3c94899350dd tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.575s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:47 user nova-compute[75235]: WARNING nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state deleted and task_state None.
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:47 user nova-compute[75235]: WARNING nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state deleted and task_state None.
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:47 user nova-compute[75235]: WARNING nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-unplugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state deleted and task_state None.
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Acquiring lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] Lock "0e7eb484-033e-4a7a-a259-a183e78a6b96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] No waiting events found dispatching network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:47 user nova-compute[75235]: WARNING nova.compute.manager [req-85acbcb6-5615-4a7a-97a4-56c64bd2c090 req-13587952-cbc1-4e61-8cfa-c53d5a10d4b1 service nova] [instance: 0e7eb484-033e-4a7a-a259-a183e78a6b96] Received unexpected event network-vif-plugged-f8907cc3-5fa0-46bf-860f-250eaa8181e8 for instance with vm_state deleted and task_state None.
Nov 29 19:10:48 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG os_brick.utils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a17b1bf-0abd-426a-ab44-70dc96a777e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88f36b-9288-4f9f-8165-6e3459a28b7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76294af-0269-4213-8fac-40d743107946]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfc301-28e0-4aaa-9baa-178c0e47e58c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:10:48 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:10:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88557a-2ee7-444f-abb9-8aee5276ca93]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:10:48 user nova-compute[75235]: DEBUG os_brick.utils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing instance network info cache due to event network-changed-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] Acquiring lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] Acquired lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Refreshing network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:50 user nova-compute[75235]: INFO nova.compute.manager [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Terminating instance
Nov 29 19:10:50 user nova-compute[75235]: DEBUG nova.compute.manager [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.network.neutron [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updated VIF entry in instance network info cache for port bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.network.neutron [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [{"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-be8f9d8d-d1c2-4855-ad11-f1a35d8ed38d req-2b400a3c-9e53-47bf-99de-62a9afb82533 service nova] Releasing lock "refresh_cache-03f7d056-56b5-45ba-a6e1-3449e35b9728" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Instance destroyed successfully.
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.objects.instance [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lazy-loading 'resources' on Instance uuid 03f7d056-56b5-45ba-a6e1-3449e35b9728 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1990269533',display_name='tempest-TestShelveInstance-server-1990269533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1990269533',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwuUAHo0jwzkFo+G9dHO4IbcAK7m9iueW3B1/f+1+oHWzOZUFmBkAbv7BvCrr8wX9PC/8xS2nCbpF9Wc2xUJnaZgsZxXOax+xZM2D/QvcuO6cO44p7ccbkoW5BOcb1egA==',key_name='tempest-TestShelveInstance-1055985921',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbb3eff325cd4b08bb2b3a3a1545433f',ramdisk_id='',reservation_id='r-s0b0nq41',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1781237838',owner_user_name='tempest-TestShelveInstance-1781237838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:09:16Z,user_data=None,user_id='d3da1a3f4fe44a6b8d177891669e67bc',uuid=03f7d056-56b5-45ba-a6e1-3449e35b9728,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converting VIF {"id": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "address": "fa:16:3e:d9:76:ef", "network": {"id": "651b90a1-1040-4735-b4c2-cecb7f4cab79", "bridge": "br-int", "label": "tempest-TestShelveInstance-406772882-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbb3eff325cd4b08bb2b3a3a1545433f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbdd8a68-f5", "ovs_interfaceid": "bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_vif [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbdd8a68-f5, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56db6120-b795-46f2-8f41-7e96061014b4) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:51 user nova-compute[75235]: INFO os_vif [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:76:ef,bridge_name='br-int',has_traffic_filtering=True,id=bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc,network=Network(651b90a1-1040-4735-b4c2-cecb7f4cab79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbdd8a68-f5')
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYRczWra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:51 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684d21e-3983-468b-84e0-84abb8685335]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:10:51 user nova-compute[75235]: No targets found.
Nov 29 19:10:51 user nova-compute[75235]: iSNS:
Nov 29 19:10:51 user nova-compute[75235]: No targets found.
Nov 29 19:10:51 user nova-compute[75235]: STATIC:
Nov 29 19:10:51 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff
Nov 29 19:10:51 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:51 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:51 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:10:51 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:10:51 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:10:51 user nova-compute[75235]: FIRMWARE:
Nov 29 19:10:51 user nova-compute[75235]: No targets found.
Nov 29 19:10:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:10:51 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:10:51 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f97f69-9cbc-4275-a376-7f05858c7975]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe441f-947e-4f45-a51c-b1618276bfba]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:51 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff (non-flash)
Nov 29 19:10:51 user nova-compute[75235]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565948b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[68adb941-490e-49f0-8b22-f8c495366335]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba328d2c-5406-4068-8416-2d1f658f6e7a]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ca3b2-2ae0-458c-b57b-fbdac4d14a58]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6d7353-94a9-49b9-996d-66435dee00a6]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb40f4-fab2-4319-bfc1-d05b4ffc12c4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7243146-e029-425b-ac0f-cfb1d6fd1c2a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260]
Nov 29 19:10:51 user nova-compute[75235]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c384bd6-f224-4711-aa47-ee9a16ca9bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f2b3bc-c9ee-4e98-8a01-c6e5030c6764]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] <== disconnect_volume: return (327ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:10:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Deleting instance files /opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728_del
Nov 29 19:10:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Deletion of /opt/stack/data/nova/instances/03f7d056-56b5-45ba-a6e1-3449e35b9728_del complete
Nov 29 19:10:51 user nova-compute[75235]: INFO nova.compute.manager [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 19:10:51 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:10:51 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:52 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Took 0.43 seconds to deallocate network for instance.
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-unplugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-unplugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-unplugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] Acquiring lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] No waiting events found dispatching network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:52 user nova-compute[75235]: WARNING nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received unexpected event network-vif-plugged-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc for instance with vm_state active and task_state deleting.
Nov 29 19:10:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec0a27d3-5d87-404d-b51a-f7fd44f31a69 req-f0659281-f7b1-48fe-9678-f57526cb9b55 service nova] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Received event network-vif-deleted-bbdd8a68-f52a-4f5c-acdf-9a45e8b046bc {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:53 user nova-compute[75235]: INFO nova.compute.manager [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Took 0.80 seconds to detach 1 volumes for instance.
Nov 29 19:10:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] [instance: 03f7d056-56b5-45ba-a6e1-3449e35b9728] Deleting volume: 5c384bd6-f224-4711-aa47-ee9a16ca9bff {{(pid=75235) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:53 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Deleted allocations for instance 03f7d056-56b5-45ba-a6e1-3449e35b9728
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-185b45b7-8dd8-4531-b41a-75f0e66de63c tempest-TestShelveInstance-1781237838 tempest-TestShelveInstance-1781237838-project-member] Lock "03f7d056-56b5-45ba-a6e1-3449e35b9728" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7564MB free_disk=25.19217300415039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Starting finish_migration {{(pid=75235) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:10:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Creating image(s)
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Applying migration context for instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 as it has an incoming, in-progress migration 53c6c408-fac2-43cc-abd9-e97c057c78bb. Migration status is post-migrating {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 19:10:56 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating resource usage from migration 53c6c408-fac2-43cc-abd9-e97c057c78bb
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 45b953a2-c6ba-4e24-96ea-f37a70faaf49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Migration 53c6c408-fac2-43cc-abd9-e97c057c78bb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk. size=21474836480 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk 21474836480 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk 21474836480" returned: 0 in 0.046s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Ensure instance console log exists: /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start _get_guest_xml network_info=[{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'e5115d03-9d30-4f8f-bde5-0b51919f6822', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '667a5ca0-f308-4eb9-a025-14c49ff25eb3', 'attached_at': '2023-11-29T19:10:56.000000', 'detached_at': '', 'volume_id': 'c4801896-ec3b-4de0-b0e7-132535a07033', 'serial': 'c4801896-ec3b-4de0-b0e7-132535a07033'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:10:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:56 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:10:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:10:56 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc4cb9e-df4c-424d-97f6-abf8ef147064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:10:56 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[01658dab-9b0f-4921-872a-ffc50f33e2ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033] added
Nov 29 19:10:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12a725-ff1d-42ae-a201-c3567ea92b46]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac7dd01-9709-419a-9791-656564058393]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLWeznm {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLWeznm" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b9c15b-9847-4275-bae4-a33ca8e6d47d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RiLWeznm'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd19367-777e-40ba-9f9e-d8570c7b6a12]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a53108-2529-4590-b749-e46f3688113e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e16e636-78db-4385-a4e9-90beb9a9c4b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]
Nov 29 19:10:57 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.
Nov 29 19:10:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c2ba54-69c0-4e10-a589-0469c54a5344]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba95b0-de27-4d18-8b63-c6ce0c167cd9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:57 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:10:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:10:57 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:10:57 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eacf5a1-eae0-48df-88af-c25245a10252]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26635353963626431', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635353963626431', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:10:58 user nova-compute[75235]:   <uuid>667a5ca0-f308-4eb9-a025-14c49ff25eb3</uuid>
Nov 29 19:10:58 user nova-compute[75235]:   <name>instance-00000014</name>
Nov 29 19:10:58 user nova-compute[75235]:   <memory>2097152</memory>
Nov 29 19:10:58 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:10:58 user nova-compute[75235]:   <metadata>
Nov 29 19:10:58 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:10:58 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:10:58 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherB-server-2026348765</nova:name>
Nov 29 19:10:58 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:10:56</nova:creationTime>
Nov 29 19:10:58 user nova-compute[75235]:       <nova:flavor name="m1.small">
Nov 29 19:10:58 user nova-compute[75235]:         <nova:memory>2048</nova:memory>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:disk>20</nova:disk>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:10:58 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:10:58 user nova-compute[75235]:       <nova:owner>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:user uuid="b1fe2271d5ad4b97acdbfcd699e3829a">tempest-ServerActionsTestOtherB-1405811153-project-member</nova:user>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:project uuid="52ccc9827eb540868fea8b5891c75338">tempest-ServerActionsTestOtherB-1405811153</nova:project>
Nov 29 19:10:58 user nova-compute[75235]:       </nova:owner>
Nov 29 19:10:58 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:10:58 user nova-compute[75235]:       <nova:ports>
Nov 29 19:10:58 user nova-compute[75235]:         <nova:port uuid="644e59e3-44e4-43e5-8d47-a226b1457182">
Nov 29 19:10:58 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:10:58 user nova-compute[75235]:         </nova:port>
Nov 29 19:10:58 user nova-compute[75235]:       </nova:ports>
Nov 29 19:10:58 user nova-compute[75235]:     </nova:instance>
Nov 29 19:10:58 user nova-compute[75235]:   </metadata>
Nov 29 19:10:58 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:10:58 user nova-compute[75235]:     <system>
Nov 29 19:10:58 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:10:58 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:10:58 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:10:58 user nova-compute[75235]:       <entry name="serial">667a5ca0-f308-4eb9-a025-14c49ff25eb3</entry>
Nov 29 19:10:58 user nova-compute[75235]:       <entry name="uuid">667a5ca0-f308-4eb9-a025-14c49ff25eb3</entry>
Nov 29 19:10:58 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:10:58 user nova-compute[75235]:     </system>
Nov 29 19:10:58 user nova-compute[75235]:   </sysinfo>
Nov 29 19:10:58 user nova-compute[75235]:   <os>
Nov 29 19:10:58 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:10:58 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:10:58 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:10:58 user nova-compute[75235]:   </os>
Nov 29 19:10:58 user nova-compute[75235]:   <features>
Nov 29 19:10:58 user nova-compute[75235]:     <acpi/>
Nov 29 19:10:58 user nova-compute[75235]:     <apic/>
Nov 29 19:10:58 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:10:58 user nova-compute[75235]:   </features>
Nov 29 19:10:58 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:10:58 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:10:58 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:10:58 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:10:58 user nova-compute[75235]:   </clock>
Nov 29 19:10:58 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:10:58 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:10:58 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:10:58 user nova-compute[75235]:   </cpu>
Nov 29 19:10:58 user nova-compute[75235]:   <devices>
Nov 29 19:10:58 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:10:58 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:10:58 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk"/>
Nov 29 19:10:58 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:10:58 user nova-compute[75235]:     </disk>
Nov 29 19:10:58 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:10:58 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:10:58 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:10:58 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:10:58 user nova-compute[75235]:       <serial>c4801896-ec3b-4de0-b0e7-132535a07033</serial>
Nov 29 19:10:58 user nova-compute[75235]:     </disk>
Nov 29 19:10:58 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:10:58 user nova-compute[75235]:       <mac address="fa:16:3e:b2:6a:b3"/>
Nov 29 19:10:58 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:10:58 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:10:58 user nova-compute[75235]:       <target dev="tap644e59e3-44"/>
Nov 29 19:10:58 user nova-compute[75235]:     </interface>
Nov 29 19:10:58 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:10:58 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/console.log" append="off"/>
Nov 29 19:10:58 user nova-compute[75235]:     </serial>
Nov 29 19:10:58 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:10:58 user nova-compute[75235]:     <video>
Nov 29 19:10:58 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:10:58 user nova-compute[75235]:     </video>
Nov 29 19:10:58 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:10:58 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:10:58 user nova-compute[75235]:     </rng>
Nov 29 19:10:58 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:10:58 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:10:58 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:10:58 user nova-compute[75235]:     </memballoon>
Nov 29 19:10:58 user nova-compute[75235]:   </devices>
Nov 29 19:10:58 user nova-compute[75235]: </domain>
Nov 29 19:10:58 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2075469504-network", "vif_mac": "fa:16:3e:b2:6a:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG os_vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfe2b9fa-0f48-5676-be48-63a3859e3c28', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap644e59e3-44, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap644e59e3-44, col_values=(('qos', UUID('273cbe63-75db-4290-9c7e-fa94fa6492cd')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap644e59e3-44, col_values=(('external_ids', {'iface-id': '644e59e3-44e4-43e5-8d47-a226b1457182', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:6a:b3', 'vm-uuid': '667a5ca0-f308-4eb9-a025-14c49ff25eb3'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:58 user nova-compute[75235]: INFO os_vif [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44')
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] No VIF found with MAC fa:16:3e:b2:6a:b3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updating instance_info_cache with network_info: [{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:58 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-6e4c889a-5d49-4e79-8143-a3d47447ebe5 req-63785ae0-9bef-4c01-972d-cc04ae77d14d service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6e4c889a-5d49-4e79-8143-a3d47447ebe5 req-63785ae0-9bef-4c01-972d-cc04ae77d14d service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6e4c889a-5d49-4e79-8143-a3d47447ebe5 req-63785ae0-9bef-4c01-972d-cc04ae77d14d service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6e4c889a-5d49-4e79-8143-a3d47447ebe5 req-63785ae0-9bef-4c01-972d-cc04ae77d14d service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:10:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-6e4c889a-5d49-4e79-8143-a3d47447ebe5 req-63785ae0-9bef-4c01-972d-cc04ae77d14d service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:10:59 user nova-compute[75235]: WARNING nova.compute.manager [req-6e4c889a-5d49-4e79-8143-a3d47447ebe5 req-63785ae0-9bef-4c01-972d-cc04ae77d14d service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state resize_finish.
Nov 29 19:11:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:00 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:11:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance running successfully.
Nov 29 19:11:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Failed to set time: agent not configured {{(pid=75235) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b2e66f0f-b5d2-4487-8636-4cbcf65a31dc tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] finish_migration finished successfully. {{(pid=75235) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-6381fcff-e9aa-4fbf-9148-94ee7d76baca req-8c4d85c7-17b3-4c1f-bbf5-f6c3ded58c69 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6381fcff-e9aa-4fbf-9148-94ee7d76baca req-8c4d85c7-17b3-4c1f-bbf5-f6c3ded58c69 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6381fcff-e9aa-4fbf-9148-94ee7d76baca req-8c4d85c7-17b3-4c1f-bbf5-f6c3ded58c69 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6381fcff-e9aa-4fbf-9148-94ee7d76baca req-8c4d85c7-17b3-4c1f-bbf5-f6c3ded58c69 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-6381fcff-e9aa-4fbf-9148-94ee7d76baca req-8c4d85c7-17b3-4c1f-bbf5-f6c3ded58c69 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:01 user nova-compute[75235]: WARNING nova.compute.manager [req-6381fcff-e9aa-4fbf-9148-94ee7d76baca req-8c4d85c7-17b3-4c1f-bbf5-f6c3ded58c69 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state resize_finish.
Nov 29 19:11:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:04 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:11:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:25 user nova-compute[75235]: INFO nova.compute.manager [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Rescuing
Nov 29 19:11:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:11:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:11:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:11:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updating instance_info_cache with network_info: [{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:11:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-3fd867e3-0212-4e9f-a266-72b1fc452426 req-c337e972-1636-4fe1-b624-a91531541009 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-unplugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3fd867e3-0212-4e9f-a266-72b1fc452426 req-c337e972-1636-4fe1-b624-a91531541009 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3fd867e3-0212-4e9f-a266-72b1fc452426 req-c337e972-1636-4fe1-b624-a91531541009 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3fd867e3-0212-4e9f-a266-72b1fc452426 req-c337e972-1636-4fe1-b624-a91531541009 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-3fd867e3-0212-4e9f-a266-72b1fc452426 req-c337e972-1636-4fe1-b624-a91531541009 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-unplugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:26 user nova-compute[75235]: WARNING nova.compute.manager [req-3fd867e3-0212-4e9f-a266-72b1fc452426 req-c337e972-1636-4fe1-b624-a91531541009 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-unplugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state active and task_state rescuing.
Nov 29 19:11:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance destroyed successfully.
Nov 29 19:11:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Attempting rescue
Nov 29 19:11:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75235) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:11:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Creating image(s)
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'trusted_certs' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue" returned: 0 in 0.053s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'migration_context' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.base [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<c0628a53-2856-47c2-8b64-651c656f9d93> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Start _get_guest_xml network_info=[{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:91:f4:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'resources' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.base [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<c0628a53-2856-47c2-8b64-651c656f9d93> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'numa_topology' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.base [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<c0628a53-2856-47c2-8b64-651c656f9d93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:27 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:11:27 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'vcpu_model' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.base [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<c0628a53-2856-47c2-8b64-651c656f9d93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1713780664',display_name='tempest-ServerRescueNegativeTestJSON-server-1713780664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1713780664',id=26,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-4r2ixeg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:43Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=c0628a53-2856-47c2-8b64-651c656f9d93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:91:f4:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:91:f4:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'pci_devices' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.objects.base [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<c0628a53-2856-47c2-8b64-651c656f9d93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:11:27 user nova-compute[75235]:   <uuid>c0628a53-2856-47c2-8b64-651c656f9d93</uuid>
Nov 29 19:11:27 user nova-compute[75235]:   <name>instance-0000001a</name>
Nov 29 19:11:27 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:11:27 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:11:27 user nova-compute[75235]:   <metadata>
Nov 29 19:11:27 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:11:27 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:11:27 user nova-compute[75235]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1713780664</nova:name>
Nov 29 19:11:27 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:11:27</nova:creationTime>
Nov 29 19:11:27 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:11:27 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:11:27 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:11:27 user nova-compute[75235]:       <nova:owner>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:user uuid="b09701817c0147aca7432e1329b82300">tempest-ServerRescueNegativeTestJSON-1726326315-project-member</nova:user>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:project uuid="a77e6e9f44ec4c76b5c8f8f29c7e651f">tempest-ServerRescueNegativeTestJSON-1726326315</nova:project>
Nov 29 19:11:27 user nova-compute[75235]:       </nova:owner>
Nov 29 19:11:27 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:11:27 user nova-compute[75235]:       <nova:ports>
Nov 29 19:11:27 user nova-compute[75235]:         <nova:port uuid="b2361512-bf5c-4207-b459-21548580307c">
Nov 29 19:11:27 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 19:11:27 user nova-compute[75235]:         </nova:port>
Nov 29 19:11:27 user nova-compute[75235]:       </nova:ports>
Nov 29 19:11:27 user nova-compute[75235]:     </nova:instance>
Nov 29 19:11:27 user nova-compute[75235]:   </metadata>
Nov 29 19:11:27 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:11:27 user nova-compute[75235]:     <system>
Nov 29 19:11:27 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:11:27 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:11:27 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:11:27 user nova-compute[75235]:       <entry name="serial">c0628a53-2856-47c2-8b64-651c656f9d93</entry>
Nov 29 19:11:27 user nova-compute[75235]:       <entry name="uuid">c0628a53-2856-47c2-8b64-651c656f9d93</entry>
Nov 29 19:11:27 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:11:27 user nova-compute[75235]:     </system>
Nov 29 19:11:27 user nova-compute[75235]:   </sysinfo>
Nov 29 19:11:27 user nova-compute[75235]:   <os>
Nov 29 19:11:27 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:11:27 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:11:27 user nova-compute[75235]:   </os>
Nov 29 19:11:27 user nova-compute[75235]:   <features>
Nov 29 19:11:27 user nova-compute[75235]:     <acpi/>
Nov 29 19:11:27 user nova-compute[75235]:     <apic/>
Nov 29 19:11:27 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:11:27 user nova-compute[75235]:   </features>
Nov 29 19:11:27 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:11:27 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:11:27 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:11:27 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:11:27 user nova-compute[75235]:   </clock>
Nov 29 19:11:27 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:11:27 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:11:27 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:11:27 user nova-compute[75235]:   </cpu>
Nov 29 19:11:27 user nova-compute[75235]:   <devices>
Nov 29 19:11:27 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:11:27 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:11:27 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue"/>
Nov 29 19:11:27 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:11:27 user nova-compute[75235]:     </disk>
Nov 29 19:11:27 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:11:27 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:11:27 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk"/>
Nov 29 19:11:27 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:11:27 user nova-compute[75235]:     </disk>
Nov 29 19:11:27 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:11:27 user nova-compute[75235]:       <mac address="fa:16:3e:91:f4:ba"/>
Nov 29 19:11:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:11:27 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:11:27 user nova-compute[75235]:       <target dev="tapb2361512-bf"/>
Nov 29 19:11:27 user nova-compute[75235]:     </interface>
Nov 29 19:11:27 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:11:27 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/console.log" append="off"/>
Nov 29 19:11:27 user nova-compute[75235]:     </serial>
Nov 29 19:11:27 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:11:27 user nova-compute[75235]:     <video>
Nov 29 19:11:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:11:27 user nova-compute[75235]:     </video>
Nov 29 19:11:27 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:11:27 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:11:27 user nova-compute[75235]:     </rng>
Nov 29 19:11:27 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:11:27 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:11:27 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:11:27 user nova-compute[75235]:     </memballoon>
Nov 29 19:11:27 user nova-compute[75235]:   </devices>
Nov 29 19:11:27 user nova-compute[75235]: </domain>
Nov 29 19:11:27 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:11:27 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance destroyed successfully.
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:11:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:91:f4:ba, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-e552568d-6c9c-47bf-8e0a-ed2601e9dec5 req-7208fe2e-656c-464d-b0ac-0a65da508569 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e552568d-6c9c-47bf-8e0a-ed2601e9dec5 req-7208fe2e-656c-464d-b0ac-0a65da508569 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e552568d-6c9c-47bf-8e0a-ed2601e9dec5 req-7208fe2e-656c-464d-b0ac-0a65da508569 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e552568d-6c9c-47bf-8e0a-ed2601e9dec5 req-7208fe2e-656c-464d-b0ac-0a65da508569 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-e552568d-6c9c-47bf-8e0a-ed2601e9dec5 req-7208fe2e-656c-464d-b0ac-0a65da508569 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:28 user nova-compute[75235]: WARNING nova.compute.manager [req-e552568d-6c9c-47bf-8e0a-ed2601e9dec5 req-7208fe2e-656c-464d-b0ac-0a65da508569 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state active and task_state rescuing.
Nov 29 19:11:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:30 user nova-compute[75235]: WARNING nova.compute.manager [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state active and task_state rescuing.
Nov 29 19:11:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:30 user nova-compute[75235]: WARNING nova.compute.manager [req-5a7d17ec-fc02-473f-a2ec-4da637d259aa req-c7906c3c-ae01-44bb-bd82-1aaa17c5aec5 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state active and task_state rescuing.
Nov 29 19:11:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5f840c16-6bc8-486b-8309-2776d0d5d857 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:11:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'flavor' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:38 user nova-compute[75235]: INFO nova.compute.manager [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Attaching volume 00f72d34-96a4-4d9b-a5be-e98c3c93649e to /dev/vdb
Nov 29 19:11:38 user nova-compute[75235]: DEBUG os_brick.utils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[80433778-16ad-417d-bb7d-9d8cb93dfa2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b85e89-fc78-4bf4-b488-a95af38dbabf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e79136-6ca5-4d2d-a82c-cd0495fa679c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3ce579-bf34-4dac-8611-30050228c0e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:11:38 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:11:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e690626-761c-48c7-a280-03df3497380f]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG os_brick.utils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:11:38 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating existing volume attachment record: ddb4cca8-2f71-4822-b064-400e6b0e9fc5 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:11:40 user nova-compute[75235]: INFO nova.compute.manager [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Rescuing
Nov 29 19:11:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:11:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:11:40 user nova-compute[75235]: DEBUG nova.network.neutron [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:11:40 user nova-compute[75235]: DEBUG nova.network.neutron [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:11:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-41a17372-6650-4a18-87a0-34ad71aff8bf req-db0abca8-eb28-4024-a08b-4103792824d0 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41a17372-6650-4a18-87a0-34ad71aff8bf req-db0abca8-eb28-4024-a08b-4103792824d0 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41a17372-6650-4a18-87a0-34ad71aff8bf req-db0abca8-eb28-4024-a08b-4103792824d0 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41a17372-6650-4a18-87a0-34ad71aff8bf req-db0abca8-eb28-4024-a08b-4103792824d0 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-41a17372-6650-4a18-87a0-34ad71aff8bf req-db0abca8-eb28-4024-a08b-4103792824d0 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:41 user nova-compute[75235]: WARNING nova.compute.manager [req-41a17372-6650-4a18-87a0-34ad71aff8bf req-db0abca8-eb28-4024-a08b-4103792824d0 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance destroyed successfully.
Nov 29 19:11:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Attempting a stable device rescue
Nov 29 19:11:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75235) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:11:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Creating image(s)
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "/opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'trusted_certs' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "b3e5228e15ce9152065bf1c961a82538ceadecb1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b3e5228e15ce9152065bf1c961a82538ceadecb1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.virt.images [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] c79f2bc2-a92b-46ee-a249-aeb538378aea was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.part /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:43 user nova-compute[75235]: WARNING nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:43 user nova-compute[75235]: WARNING nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:43 user nova-compute[75235]: WARNING nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:43 user nova-compute[75235]: WARNING nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:43 user nova-compute[75235]: WARNING nova.compute.manager [req-d4e781ce-d4bd-4504-85cc-10bb0adaff2e req-00287a99-04a3-484c-9280-324333291c98 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.part /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.converted" returned: 0 in 0.558s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b3e5228e15ce9152065bf1c961a82538ceadecb1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.338s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "b3e5228e15ce9152065bf1c961a82538ceadecb1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b3e5228e15ce9152065bf1c961a82538ceadecb1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1 --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1,backing_fmt=raw /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1,backing_fmt=raw /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue" returned: 0 in 0.052s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b3e5228e15ce9152065bf1c961a82538ceadecb1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'migration_context' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<b53656ac-d97b-4845-9be5-04f96f00d07e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Start _get_guest_xml network_info=[{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "vif_mac": "fa:16:3e:ce:33:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c79f2bc2-a92b-46ee-a249-aeb538378aea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8c9d2246-6a97-4610-b3d0-94a727310183', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b53656ac-d97b-4845-9be5-04f96f00d07e', 'attached_at': '', 'detached_at': '', 'volume_id': '747108f3-52f2-4145-a286-a99ff5c225e5', 'serial': '747108f3-52f2-4145-a286-a99ff5c225e5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'resources' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<b53656ac-d97b-4845-9be5-04f96f00d07e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'numa_topology' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<b53656ac-d97b-4845-9be5-04f96f00d07e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:11:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'vcpu_model' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.objects.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<b53656ac-d97b-4845-9be5-04f96f00d07e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:11:44 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:11:44 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:11:44 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b60116-5846-4fee-87fc-7e50c924c2b1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = SzBLxwqD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 19:11:44 user nova-compute[75235]: node.name = iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:11:44 user nova-compute[75235]: node.tpgt = -1
Nov 29 19:11:44 user nova-compute[75235]: node.startup = automatic
Nov 29 19:11:44 user nova-compute[75235]: node.leading_login = No
Nov 29 19:11:44 user nova-compute[75235]: iface.iscsi_ifacename = default
Nov 29 19:11:44 user nova-compute[75235]: iface.net_ifacename = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.ipaddress = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.prefix_len = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.hwaddress = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.transport_name = tcp
Nov 29 19:11:44 user nova-compute[75235]: iface.initiatorname = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.vlan_id = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.vlan_priority = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.vlan_state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.iface_num = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.mtu = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.port = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.bootproto = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.subnet_mask = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.gateway = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_alt_client_id = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_dns = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_learn_iqn = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_vendor_id_state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_vendor_id = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.dhcp_slp_da = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.fragmentation = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.gratuitous_arp = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.incoming_forwarding = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.tos_state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.tos = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.ttl = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.delayed_ack = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.tcp_nagle = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.tcp_wsf_state = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.tcp_wsf = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.tcp_timer_scale = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.tcp_timestamp = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.redirect = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.def_task_mgmt_timeout = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.header_digest = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.data_digest = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.immediate_data = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.initial_r2t = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.data_seq_inorder = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.data_pdu_inorder = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.erl = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.max_receive_data_len = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.first_burst_len = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.max_outstanding_r2t = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.max_burst_len = 0
Nov 29 19:11:44 user nova-compute[75235]: iface.chap_auth = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.bidi_chap = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.strict_login_compliance = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.discovery_auth = <empty>
Nov 29 19:11:44 user nova-compute[75235]: iface.discovery_logout = <empty>
Nov 29 19:11:44 user nova-compute[75235]: node.discovery_address = <empty>
Nov 29 19:11:44 user nova-compute[75235]: node.discovery_port = 0
Nov 29 19:11:44 user nova-compute[75235]: node.discovery_type = static
Nov 29 19:11:44 user nova-compute[75235]: node.session.initial_cmdsn = 0
Nov 29 19:11:44 user nova-compute[75235]: node.session.initial_login_retry_max = 8
Nov 29 19:11:44 user nova-compute[75235]: node.session.xmit_thread_priority = -20
Nov 29 19:11:44 user nova-compute[75235]: node.session.cmds_max = 128
Nov 29 19:11:44 user nova-compute[75235]: node.session.queue_depth = 32
Nov 29 19:11:44 user nova-compute[75235]: node.session.nr_sessions = 1
Nov 29 19:11:44 user nova-compute[75235]: node.session.auth.authmethod = CHAP
Nov 29 19:11:44 user nova-compute[75235]: node.session.auth.username = SzBLxwqD
Nov 29 19:11:44 user nova-compute[75235]: node.session.auth.password = ***
Nov 29 19:11:44 user nova-compute[75235]: node.session.auth.username_in = <empty>
Nov 29 19:11:44 user nova-compute[75235]: node.session.auth.password_in = <empty>
Nov 29 19:11:44 user nova-compute[75235]: node.session.auth.chap_algs = MD5
Nov 29 19:11:44 user nova-compute[75235]: node.session.timeo.replacement_timeout = 120
Nov 29 19:11:44 user nova-compute[75235]: node.session.err_timeo.abort_timeout = 15
Nov 29 19:11:44 user nova-compute[75235]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 19:11:44 user nova-compute[75235]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 19:11:44 user nova-compute[75235]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.FastAbort = Yes
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.InitialR2T = No
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.ImmediateData = Yes
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.MaxConnections = 1
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 19:11:44 user nova-compute[75235]: node.session.iscsi.ERL = 0
Nov 29 19:11:44 user nova-compute[75235]: node.session.scan = manual
Nov 29 19:11:44 user nova-compute[75235]: node.session.reopen_max = 0
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].address = 172.16.0.220
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].port = 3260
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].startup = manual
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].tcp.window_size = 524288
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].tcp.type_of_service = 0
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].timeo.logout_timeout = 15
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].timeo.login_timeout = 15
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].timeo.auth_timeout = 45
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].iscsi.DataDigest = None
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].iscsi.IFMarker = No
Nov 29 19:11:44 user nova-compute[75235]: node.conn[0].iscsi.OFMarker = No
Nov 29 19:11:44 user nova-compute[75235]: # END RECORD
Nov 29 19:11:44 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062ecc6-3478-4fbc-9fdd-251a0dba7d52]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e77b28c-674a-4b6e-b6f2-13ba9606fd10]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzBLxwqD {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzBLxwqD" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef5c7b-7418-478e-8812-99e280c91811]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SzBLxwqD'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11b250c-5124-4701-9ce7-3bbe3cd65e1d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cff3b7f-2411-4e8f-9dbe-33987563769b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:11:44 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:11:44 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:11:44 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:11:44 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.196s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] HCTL ('36', '0', '0', 0) found on session 27 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e25ab-c10a-4648-9ef1-30af0fa20ffa]: (4, ('0 0 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching for a device in session 27 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.234s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '23966303332663461', 'path': '/dev/sde'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:11:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966303332663461', 'path': '/dev/sde'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-270576405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-270576405',id=28,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:10:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-gl6y1qrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:10:10Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=b53656ac-d97b-4845-9be5-04f96f00d07e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "vif_mac": "fa:16:3e:ce:33:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "vif_mac": "fa:16:3e:ce:33:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'pci_devices' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.objects.base [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<b53656ac-d97b-4845-9be5-04f96f00d07e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:11:45 user nova-compute[75235]:   <uuid>b53656ac-d97b-4845-9be5-04f96f00d07e</uuid>
Nov 29 19:11:45 user nova-compute[75235]:   <name>instance-0000001c</name>
Nov 29 19:11:45 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:11:45 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:11:45 user nova-compute[75235]:   <metadata>
Nov 29 19:11:45 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:11:45 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:11:45 user nova-compute[75235]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-270576405</nova:name>
Nov 29 19:11:45 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:11:44</nova:creationTime>
Nov 29 19:11:45 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:11:45 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:11:45 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:11:45 user nova-compute[75235]:       <nova:owner>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:user uuid="c547f019112442b7ac97442ce3432365">tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member</nova:user>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:project uuid="9b84f68d6c554611a982ef7326409952">tempest-ServerBootFromVolumeStableRescueTest-1553615524</nova:project>
Nov 29 19:11:45 user nova-compute[75235]:       </nova:owner>
Nov 29 19:11:45 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:11:45 user nova-compute[75235]:       <nova:ports>
Nov 29 19:11:45 user nova-compute[75235]:         <nova:port uuid="98e2266a-a115-4895-b4a6-d367103eed30">
Nov 29 19:11:45 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:11:45 user nova-compute[75235]:         </nova:port>
Nov 29 19:11:45 user nova-compute[75235]:       </nova:ports>
Nov 29 19:11:45 user nova-compute[75235]:     </nova:instance>
Nov 29 19:11:45 user nova-compute[75235]:   </metadata>
Nov 29 19:11:45 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:11:45 user nova-compute[75235]:     <system>
Nov 29 19:11:45 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:11:45 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:11:45 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:11:45 user nova-compute[75235]:       <entry name="serial">b53656ac-d97b-4845-9be5-04f96f00d07e</entry>
Nov 29 19:11:45 user nova-compute[75235]:       <entry name="uuid">b53656ac-d97b-4845-9be5-04f96f00d07e</entry>
Nov 29 19:11:45 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:11:45 user nova-compute[75235]:     </system>
Nov 29 19:11:45 user nova-compute[75235]:   </sysinfo>
Nov 29 19:11:45 user nova-compute[75235]:   <os>
Nov 29 19:11:45 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:11:45 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:11:45 user nova-compute[75235]:   </os>
Nov 29 19:11:45 user nova-compute[75235]:   <features>
Nov 29 19:11:45 user nova-compute[75235]:     <acpi/>
Nov 29 19:11:45 user nova-compute[75235]:     <apic/>
Nov 29 19:11:45 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:11:45 user nova-compute[75235]:   </features>
Nov 29 19:11:45 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:11:45 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:11:45 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:11:45 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:11:45 user nova-compute[75235]:   </clock>
Nov 29 19:11:45 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:11:45 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:11:45 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:11:45 user nova-compute[75235]:   </cpu>
Nov 29 19:11:45 user nova-compute[75235]:   <devices>
Nov 29 19:11:45 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:11:45 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:11:45 user nova-compute[75235]:       <source dev="/dev/sde"/>
Nov 29 19:11:45 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:11:45 user nova-compute[75235]:       <serial>747108f3-52f2-4145-a286-a99ff5c225e5</serial>
Nov 29 19:11:45 user nova-compute[75235]:     </disk>
Nov 29 19:11:45 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:11:45 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:11:45 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue"/>
Nov 29 19:11:45 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:11:45 user nova-compute[75235]:       <boot order="1"/>
Nov 29 19:11:45 user nova-compute[75235]:     </disk>
Nov 29 19:11:45 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:11:45 user nova-compute[75235]:       <mac address="fa:16:3e:ce:33:3f"/>
Nov 29 19:11:45 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:11:45 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:11:45 user nova-compute[75235]:       <target dev="tap98e2266a-a1"/>
Nov 29 19:11:45 user nova-compute[75235]:     </interface>
Nov 29 19:11:45 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:11:45 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/console.log" append="off"/>
Nov 29 19:11:45 user nova-compute[75235]:     </serial>
Nov 29 19:11:45 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:11:45 user nova-compute[75235]:     <video>
Nov 29 19:11:45 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:11:45 user nova-compute[75235]:     </video>
Nov 29 19:11:45 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:11:45 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:11:45 user nova-compute[75235]:     </rng>
Nov 29 19:11:45 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:11:45 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:11:45 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:11:45 user nova-compute[75235]:     </memballoon>
Nov 29 19:11:45 user nova-compute[75235]:   </devices>
Nov 29 19:11:45 user nova-compute[75235]: </domain>
Nov 29 19:11:45 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:11:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance destroyed successfully.
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:11:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No VIF found with MAC fa:16:3e:ce:33:3f, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-03f1e63c-c6bd-466a-b9fa-4bb694646d45 req-c3f95a08-68fd-4f39-b64f-8829683d752d service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-03f1e63c-c6bd-466a-b9fa-4bb694646d45 req-c3f95a08-68fd-4f39-b64f-8829683d752d service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-03f1e63c-c6bd-466a-b9fa-4bb694646d45 req-c3f95a08-68fd-4f39-b64f-8829683d752d service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-03f1e63c-c6bd-466a-b9fa-4bb694646d45 req-c3f95a08-68fd-4f39-b64f-8829683d752d service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-03f1e63c-c6bd-466a-b9fa-4bb694646d45 req-c3f95a08-68fd-4f39-b64f-8829683d752d service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:46 user nova-compute[75235]: WARNING nova.compute.manager [req-03f1e63c-c6bd-466a-b9fa-4bb694646d45 req-c3f95a08-68fd-4f39-b64f-8829683d752d service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:11:47 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:11:47 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:11:47 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[95931349-9505-4f1a-86d1-949aa8932fd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:11:47 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[490e1e78-e3eb-47f9-8cf4-7e5125fca574]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e] added
Nov 29 19:11:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298d7ec-4f86-4bc9-a4ac-a224897d08b0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a3d35b-8c17-4058-8815-2ba2fd4aa8fd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwMsLRXW {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwMsLRXW" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ffbba7-8a67-4d30-bdbd-6070163dad62]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwMsLRXW'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d347ec3-8b71-4d5d-99dc-ec4b0e840854]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aa8de1-4f6c-41e6-9154-eeb3fff9fc84]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf914fe-74f5-4678-89c7-cc2e4ed79f70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]
Nov 29 19:11:47 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.
Nov 29 19:11:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b95a26-8112-4f5f-8ecb-a8cc82c689cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9bbb9b-c0b6-4606-9b52-380da8c7516a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:11:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:11:47 user nova-compute[75235]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:11:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d6767b-0d4a-4c46-a687-1280dd9a39fa]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:11:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23130356632333630', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356632333630', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-e78e0c7f-4f47-4d45-bea8-d335630df4a1 req-21fbaebd-1f33-410b-b4ee-ebfb2f8e2425 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e78e0c7f-4f47-4d45-bea8-d335630df4a1 req-21fbaebd-1f33-410b-b4ee-ebfb2f8e2425 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e78e0c7f-4f47-4d45-bea8-d335630df4a1 req-21fbaebd-1f33-410b-b4ee-ebfb2f8e2425 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e78e0c7f-4f47-4d45-bea8-d335630df4a1 req-21fbaebd-1f33-410b-b4ee-ebfb2f8e2425 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-e78e0c7f-4f47-4d45-bea8-d335630df4a1 req-21fbaebd-1f33-410b-b4ee-ebfb2f8e2425 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:48 user nova-compute[75235]: WARNING nova.compute.manager [req-e78e0c7f-4f47-4d45-bea8-d335630df4a1 req-21fbaebd-1f33-410b-b4ee-ebfb2f8e2425 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state rescuing.
Nov 29 19:11:48 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'flavor' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-2680ec8c-7a13-4ed0-9a11-7f5b54b44efb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:11:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:11:49 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:11:49 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:11:49 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:11:49 user nova-compute[75235]:   <serial>00f72d34-96a4-4d9b-a5be-e98c3c93649e</serial>
Nov 29 19:11:49 user nova-compute[75235]: </disk>
Nov 29 19:11:49 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:11:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:11:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:11:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No VIF found with MAC fa:16:3e:28:20:de, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:11:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e6aeb389-8333-4c0a-aeac-2f09d7ef4c17 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.252s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:52 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:11:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:11:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:11:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing instance network info cache due to event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:11:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:58 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:11:58 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7581MB free_disk=25.082706451416016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:58 user nova-compute[75235]: INFO nova.compute.manager [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Terminating instance
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Applying migration context for instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 as it has an incoming, in-progress migration 53c6c408-fac2-43cc-abd9-e97c057c78bb. Migration status is finished {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 19:11:58 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating resource usage from migration 53c6c408-fac2-43cc-abd9-e97c057c78bb
Nov 29 19:11:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updated VIF entry in instance network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b8fcbe79-caf5-4b5a-a1f4-f84ca2d9e8c0 req-227c933f-c49b-47d1-990d-e3a33f9939ce service nova] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 45b953a2-c6ba-4e24-96ea-f37a70faaf49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Migration 53c6c408-fac2-43cc-abd9-e97c057c78bb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:11:58 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:11:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Instance destroyed successfully.
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.objects.instance [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lazy-loading 'resources' on Instance uuid 45b953a2-c6ba-4e24-96ea-f37a70faaf49 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:10:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-863396336',display_name='tempest-VolumesActionsTest-instance-863396336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-863396336',id=29,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:10:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8daa1f254776450186b9239a565ecd30',ramdisk_id='',reservation_id='r-9v8mamyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-426343452',owner_user_name='tempest-VolumesActionsTest-426343452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:10:15Z,user_data=None,user_id='0f245202e6044bcdb5ce590c3d106bb2',uuid=45b953a2-c6ba-4e24-96ea-f37a70faaf49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converting VIF {"id": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "address": "fa:16:3e:49:65:69", "network": {"id": "f625565c-c2a0-42f7-8127-f8f2cd25b05f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-5681791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8daa1f254776450186b9239a565ecd30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fda01c3-ec", "ovs_interfaceid": "6fda01c3-ecc5-48e3-ac89-29351c70ff89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG os_vif [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fda01c3-ec, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e9f328a-0e0b-4a87-8ea9-a2b53ca2fbb0) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:11:59 user nova-compute[75235]: INFO os_vif [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:65:69,bridge_name='br-int',has_traffic_filtering=True,id=6fda01c3-ecc5-48e3-ac89-29351c70ff89,network=Network(f625565c-c2a0-42f7-8127-f8f2cd25b05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fda01c3-ec')
Nov 29 19:11:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Deleting instance files /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49_del
Nov 29 19:11:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Deletion of /opt/stack/data/nova/instances/45b953a2-c6ba-4e24-96ea-f37a70faaf49_del complete
Nov 29 19:11:59 user nova-compute[75235]: INFO nova.compute.manager [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.980s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-vif-unplugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] No waiting events found dispatching network-vif-unplugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-vif-unplugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] Acquiring lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] No waiting events found dispatching network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:11:59 user nova-compute[75235]: WARNING nova.compute.manager [req-5b0b5d21-8a8d-4f82-b2ac-9fac654eddd9 req-306590c0-4ac5-44cf-ba01-cba1993fc17f service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received unexpected event network-vif-plugged-6fda01c3-ecc5-48e3-ac89-29351c70ff89 for instance with vm_state active and task_state deleting.
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:11:59 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Took 0.52 seconds to deallocate network for instance.
Nov 29 19:11:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-401bfee0-ae04-418c-8bd4-27bc44e52825 req-6809ef61-52b0-429d-8e1a-cf81cf880964 service nova] [instance: 45b953a2-c6ba-4e24-96ea-f37a70faaf49] Received event network-vif-deleted-6fda01c3-ecc5-48e3-ac89-29351c70ff89 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:11:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:00 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:12:00 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:12:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:00 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Deleted allocations for instance 45b953a2-c6ba-4e24-96ea-f37a70faaf49
Nov 29 19:12:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6af6a0d6-89c9-4dd1-a5f9-e5e5119d1a5b tempest-VolumesActionsTest-426343452 tempest-VolumesActionsTest-426343452-project-member] Lock "45b953a2-c6ba-4e24-96ea-f37a70faaf49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.823s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing instance network info cache due to event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:12:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:01 user nova-compute[75235]: DEBUG nova.network.neutron [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updated VIF entry in instance network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3d2f80d-3037-4490-8c3e-aa4b470741c6 req-2ab37327-f07e-4888-8356-976647b084dc service nova] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:12:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:12:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:12:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:06 user nova-compute[75235]: INFO nova.compute.manager [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Rebooting instance
Nov 29 19:12:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance destroyed successfully.
Nov 29 19:12:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'resources' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-944730773',display_name='tempest-TestMinimumBasicScenario-server-944730773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-944730773',id=27,image_ref='28cd689c-cf20-4711-8908-bc2161826e48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLc5L/3ikTAmF40N0kwuBkwON2gpV6ZhKtBUiyc1D29JdVe4NFAZZz01pKjdeff/HIAnbJUe2AocBXM0xF1uVOEx/RV45kJstVwP7EktflDZYhnyTAFGV5Jxpb837+Yw==',key_name='tempest-TestMinimumBasicScenario-1275015280',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0s7jj5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28cd689c-cf20-4711-8908-bc2161826e48',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:07Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=7c38c492-a28b-4f1f-96f4-5e2dde6d9de2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50e951a8-64, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dd7a079-1414-4d63-b774-c93d317b6448) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:07 user nova-compute[75235]: INFO os_vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64')
Nov 29 19:12:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:07 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd244c-7beb-42e8-a444-b6897261b07b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:12:07 user nova-compute[75235]: No targets found.
Nov 29 19:12:07 user nova-compute[75235]: iSNS:
Nov 29 19:12:07 user nova-compute[75235]: No targets found.
Nov 29 19:12:07 user nova-compute[75235]: STATIC:
Nov 29 19:12:07 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033
Nov 29 19:12:07 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:12:07 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:12:07 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:12:07 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:12:07 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:12:07 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e
Nov 29 19:12:07 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:12:07 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:12:07 user nova-compute[75235]: FIRMWARE:
Nov 29 19:12:07 user nova-compute[75235]: No targets found.
Nov 29 19:12:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:12:07 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:12:07 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f216e2e-4479-4c72-ab17-5858251afa6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f8d9ae-a128-4080-ac70-f9c4df4a7c40]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:07 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:07 user nova-compute[75235]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:07 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:07 user nova-compute[75235]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c729f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90e71b-14d4-4f4b-948c-9714e3fe2226]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[627934a0-9bee-4822-9ae9-49277f17bc62]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2a032f-1db6-40f0-a618-4a8d729edd2a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4216a61-eddb-4632-90c7-6ba193d74a9e]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[403fab2b-4e5f-47c0-bb89-e9813cb85c35]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d0b68e-0b40-42de-84b2-3adc34d568b6]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]
Nov 29 19:12:07 user nova-compute[75235]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.
Nov 29 19:12:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e41b9a-a24f-4eb6-a836-d7476c986911]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== disconnect_volume: return (308ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Start _get_guest_xml network_info=[{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=28cd689c-cf20-4711-8908-bc2161826e48,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '28cd689c-cf20-4711-8908-bc2161826e48'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'ddb4cca8-2f71-4822-b064-400e6b0e9fc5', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7c38c492-a28b-4f1f-96f4-5e2dde6d9de2', 'attached_at': '', 'detached_at': '', 'volume_id': '00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'serial': '00f72d34-96a4-4d9b-a5be-e98c3c93649e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:12:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=28cd689c-cf20-4711-8908-bc2161826e48,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.objects.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Object Instance<7c38c492-a28b-4f1f-96f4-5e2dde6d9de2> lazy-loaded attributes: resources,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:08 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e26abd-79ec-4619-b65c-455aeaa65eec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:12:08 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a665af-eafe-40f4-aba9-709e1d96a65e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e] added
Nov 29 19:12:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1caa277-765c-4992-96b4-e119989a1d8e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f7059-6b6b-4dad-be70-5c00b90aec96]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwMsLRXW {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwMsLRXW" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d241f18c-cce9-40aa-b3cd-de193350cac1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwMsLRXW'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[baafb571-8147-4e9f-b06e-165ecc3442a0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8095be40-7928-4d73-8715-00de9fae55b8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f6cfc5-9de8-4a8e-a29d-e8c05c2f9d37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]
Nov 29 19:12:08 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.
Nov 29 19:12:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0094bc7d-baf2-425d-a6c4-a56ba656437d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f34a96-5fe5-4bd5-b4f1-2b671b929a91]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:08 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae18b6-8b77-4771-a43d-505609b59550]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:12:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23130356632333630', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356632333630', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-944730773',display_name='tempest-TestMinimumBasicScenario-server-944730773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-944730773',id=27,image_ref='28cd689c-cf20-4711-8908-bc2161826e48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLc5L/3ikTAmF40N0kwuBkwON2gpV6ZhKtBUiyc1D29JdVe4NFAZZz01pKjdeff/HIAnbJUe2AocBXM0xF1uVOEx/RV45kJstVwP7EktflDZYhnyTAFGV5Jxpb837+Yw==',key_name='tempest-TestMinimumBasicScenario-1275015280',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0s7jj5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28cd689c-cf20-4711-8908-bc2161826e48',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:07Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=7c38c492-a28b-4f1f-96f4-5e2dde6d9de2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.objects.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Object Instance<7c38c492-a28b-4f1f-96f4-5e2dde6d9de2> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:12:09 user nova-compute[75235]:   <uuid>7c38c492-a28b-4f1f-96f4-5e2dde6d9de2</uuid>
Nov 29 19:12:09 user nova-compute[75235]:   <name>instance-0000001b</name>
Nov 29 19:12:09 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:12:09 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:12:09 user nova-compute[75235]:   <metadata>
Nov 29 19:12:09 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:12:09 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:12:09 user nova-compute[75235]:       <nova:name>tempest-TestMinimumBasicScenario-server-944730773</nova:name>
Nov 29 19:12:09 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:12:08</nova:creationTime>
Nov 29 19:12:09 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:12:09 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:12:09 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:12:09 user nova-compute[75235]:       <nova:owner>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:user uuid="3b20e89d8a3f4c29a3e97aceccff1ac6">tempest-TestMinimumBasicScenario-937004198-project-member</nova:user>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:project uuid="af8731c8d62643ada4847f70bdb57d4e">tempest-TestMinimumBasicScenario-937004198</nova:project>
Nov 29 19:12:09 user nova-compute[75235]:       </nova:owner>
Nov 29 19:12:09 user nova-compute[75235]:       <nova:root type="image" uuid="28cd689c-cf20-4711-8908-bc2161826e48"/>
Nov 29 19:12:09 user nova-compute[75235]:       <nova:ports>
Nov 29 19:12:09 user nova-compute[75235]:         <nova:port uuid="50e951a8-6444-4285-930b-f59efb7eea7b">
Nov 29 19:12:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:12:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:12:09 user nova-compute[75235]:       </nova:ports>
Nov 29 19:12:09 user nova-compute[75235]:     </nova:instance>
Nov 29 19:12:09 user nova-compute[75235]:   </metadata>
Nov 29 19:12:09 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:12:09 user nova-compute[75235]:     <system>
Nov 29 19:12:09 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:12:09 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:12:09 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:12:09 user nova-compute[75235]:       <entry name="serial">7c38c492-a28b-4f1f-96f4-5e2dde6d9de2</entry>
Nov 29 19:12:09 user nova-compute[75235]:       <entry name="uuid">7c38c492-a28b-4f1f-96f4-5e2dde6d9de2</entry>
Nov 29 19:12:09 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:12:09 user nova-compute[75235]:     </system>
Nov 29 19:12:09 user nova-compute[75235]:   </sysinfo>
Nov 29 19:12:09 user nova-compute[75235]:   <os>
Nov 29 19:12:09 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:12:09 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:12:09 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:12:09 user nova-compute[75235]:   </os>
Nov 29 19:12:09 user nova-compute[75235]:   <features>
Nov 29 19:12:09 user nova-compute[75235]:     <acpi/>
Nov 29 19:12:09 user nova-compute[75235]:     <apic/>
Nov 29 19:12:09 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:12:09 user nova-compute[75235]:   </features>
Nov 29 19:12:09 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:12:09 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:12:09 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:12:09 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:12:09 user nova-compute[75235]:   </clock>
Nov 29 19:12:09 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:12:09 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:12:09 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:12:09 user nova-compute[75235]:   </cpu>
Nov 29 19:12:09 user nova-compute[75235]:   <devices>
Nov 29 19:12:09 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:12:09 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:12:09 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk"/>
Nov 29 19:12:09 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:12:09 user nova-compute[75235]:     </disk>
Nov 29 19:12:09 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:12:09 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:12:09 user nova-compute[75235]:       <source dev="/dev/sdc"/>
Nov 29 19:12:09 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:12:09 user nova-compute[75235]:       <serial>00f72d34-96a4-4d9b-a5be-e98c3c93649e</serial>
Nov 29 19:12:09 user nova-compute[75235]:     </disk>
Nov 29 19:12:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:12:09 user nova-compute[75235]:       <mac address="fa:16:3e:28:20:de"/>
Nov 29 19:12:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:12:09 user nova-compute[75235]:       <target dev="tap50e951a8-64"/>
Nov 29 19:12:09 user nova-compute[75235]:     </interface>
Nov 29 19:12:09 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:12:09 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/console.log" append="off"/>
Nov 29 19:12:09 user nova-compute[75235]:     </serial>
Nov 29 19:12:09 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:12:09 user nova-compute[75235]:     <video>
Nov 29 19:12:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:09 user nova-compute[75235]:     </video>
Nov 29 19:12:09 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:12:09 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:12:09 user nova-compute[75235]:     </rng>
Nov 29 19:12:09 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:12:09 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:12:09 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:12:09 user nova-compute[75235]:     </memballoon>
Nov 29 19:12:09 user nova-compute[75235]:   </devices>
Nov 29 19:12:09 user nova-compute[75235]: </domain>
Nov 29 19:12:09 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-adda228b-011c-4410-a719-a98a5126fb2b req-4d4bb440-f250-4208-9418-c47e3678ea78 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-unplugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-adda228b-011c-4410-a719-a98a5126fb2b req-4d4bb440-f250-4208-9418-c47e3678ea78 service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-adda228b-011c-4410-a719-a98a5126fb2b req-4d4bb440-f250-4208-9418-c47e3678ea78 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-adda228b-011c-4410-a719-a98a5126fb2b req-4d4bb440-f250-4208-9418-c47e3678ea78 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-adda228b-011c-4410-a719-a98a5126fb2b req-4d4bb440-f250-4208-9418-c47e3678ea78 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-unplugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:09 user nova-compute[75235]: WARNING nova.compute.manager [req-adda228b-011c-4410-a719-a98a5126fb2b req-4d4bb440-f250-4208-9418-c47e3678ea78 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-unplugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG nova.objects.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Object Instance<7c38c492-a28b-4f1f-96f4-5e2dde6d9de2> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Cannot resize image /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'migration_context' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Object Instance<7c38c492-a28b-4f1f-96f4-5e2dde6d9de2> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-944730773',display_name='tempest-TestMinimumBasicScenario-server-944730773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-944730773',id=27,image_ref='28cd689c-cf20-4711-8908-bc2161826e48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLc5L/3ikTAmF40N0kwuBkwON2gpV6ZhKtBUiyc1D29JdVe4NFAZZz01pKjdeff/HIAnbJUe2AocBXM0xF1uVOEx/RV45kJstVwP7EktflDZYhnyTAFGV5Jxpb837+Yw==',key_name='tempest-TestMinimumBasicScenario-1275015280',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0s7jj5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28cd689c-cf20-4711-8908-bc2161826e48',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:07Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=7c38c492-a28b-4f1f-96f4-5e2dde6d9de2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG os_vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ad7676c-4fb3-5ef4-bf27-c3dad4dd1075', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50e951a8-64, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50e951a8-64, col_values=(('qos', UUID('b1a15a6c-f8f1-4e63-b550-f1b36353a3a6')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50e951a8-64, col_values=(('external_ids', {'iface-id': '50e951a8-6444-4285-930b-f59efb7eea7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:20:de', 'vm-uuid': '7c38c492-a28b-4f1f-96f4-5e2dde6d9de2'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:10 user nova-compute[75235]: INFO os_vif [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64')
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "0547745d-4f60-430a-ad64-2607002b2c7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-88e35c11-362d-405b-8d3b-3500f7e2106e req-5ef2d3aa-702d-4aaf-93f6-0e554da26221 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-88e35c11-362d-405b-8d3b-3500f7e2106e req-5ef2d3aa-702d-4aaf-93f6-0e554da26221 service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-88e35c11-362d-405b-8d3b-3500f7e2106e req-5ef2d3aa-702d-4aaf-93f6-0e554da26221 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-88e35c11-362d-405b-8d3b-3500f7e2106e req-5ef2d3aa-702d-4aaf-93f6-0e554da26221 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-88e35c11-362d-405b-8d3b-3500f7e2106e req-5ef2d3aa-702d-4aaf-93f6-0e554da26221 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:11 user nova-compute[75235]: WARNING nova.compute.manager [req-88e35c11-362d-405b-8d3b-3500f7e2106e req-5ef2d3aa-702d-4aaf-93f6-0e554da26221 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 19:12:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:12:11 user nova-compute[75235]: INFO nova.compute.claims [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Claim successful on node user
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:12:12 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.policy [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b23af78dce5c439b85a3cd330ad40437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876373b8352b4a98be085d0f1053226e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:12:12 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Creating image(s)
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "/opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "/opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "/opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Successfully created port: 1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk 1073741824" returned: 0 in 0.075s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:12:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Cannot resize image /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Ensure instance console log exists: /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:13 user nova-compute[75235]: WARNING nova.compute.manager [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:13 user nova-compute[75235]: WARNING nova.compute.manager [req-4dde4b0c-511d-4331-9105-eb6325154e18 req-1c70ceb2-9160-4c0d-a945-7381c300435a service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state active and task_state reboot_started_hard.
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Successfully updated port: 1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "refresh_cache-0547745d-4f60-430a-ad64-2607002b2c7d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquired lock "refresh_cache-0547745d-4f60-430a-ad64-2607002b2c7d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-changed-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Refreshing instance network info cache due to event network-changed-1733ebcd-4c74-4d67-9a8c-26b667cd4a84. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] Acquiring lock "refresh_cache-0547745d-4f60-430a-ad64-2607002b2c7d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:12:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance rebooted successfully.
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ed69bab9-1b81-488a-a1e4-aa12bebacfd8 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.702s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Updating instance_info_cache with network_info: [{"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Releasing lock "refresh_cache-0547745d-4f60-430a-ad64-2607002b2c7d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Instance network_info: |[{"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:12:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] Acquired lock "refresh_cache-0547745d-4f60-430a-ad64-2607002b2c7d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Refreshing network info cache for port 1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Start _get_guest_xml network_info=[{"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:12:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861594596',display_name='tempest-VolumesActionsTest-instance-1861594596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861594596',id=30,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='876373b8352b4a98be085d0f1053226e',ramdisk_id='',reservation_id='r-rhxzc3e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1431976470',owner_user_name='tempest-VolumesActionsTest-1431976470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:12Z,user_data=None,user_id='b23af78dce5c439b85a3cd330ad40437',uuid=0547745d-4f60-430a-ad64-2607002b2c7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Converting VIF {"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lazy-loading 'pci_devices' on Instance uuid 0547745d-4f60-430a-ad64-2607002b2c7d {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:12:14 user nova-compute[75235]:   <uuid>0547745d-4f60-430a-ad64-2607002b2c7d</uuid>
Nov 29 19:12:14 user nova-compute[75235]:   <name>instance-0000001e</name>
Nov 29 19:12:14 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:12:14 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:12:14 user nova-compute[75235]:   <metadata>
Nov 29 19:12:14 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:12:14 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:12:14 user nova-compute[75235]:       <nova:name>tempest-VolumesActionsTest-instance-1861594596</nova:name>
Nov 29 19:12:14 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:12:14</nova:creationTime>
Nov 29 19:12:14 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:12:14 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:12:14 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:12:14 user nova-compute[75235]:       <nova:owner>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:user uuid="b23af78dce5c439b85a3cd330ad40437">tempest-VolumesActionsTest-1431976470-project-member</nova:user>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:project uuid="876373b8352b4a98be085d0f1053226e">tempest-VolumesActionsTest-1431976470</nova:project>
Nov 29 19:12:14 user nova-compute[75235]:       </nova:owner>
Nov 29 19:12:14 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:12:14 user nova-compute[75235]:       <nova:ports>
Nov 29 19:12:14 user nova-compute[75235]:         <nova:port uuid="1733ebcd-4c74-4d67-9a8c-26b667cd4a84">
Nov 29 19:12:14 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 19:12:14 user nova-compute[75235]:         </nova:port>
Nov 29 19:12:14 user nova-compute[75235]:       </nova:ports>
Nov 29 19:12:14 user nova-compute[75235]:     </nova:instance>
Nov 29 19:12:14 user nova-compute[75235]:   </metadata>
Nov 29 19:12:14 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:12:14 user nova-compute[75235]:     <system>
Nov 29 19:12:14 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:12:14 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:12:14 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:12:14 user nova-compute[75235]:       <entry name="serial">0547745d-4f60-430a-ad64-2607002b2c7d</entry>
Nov 29 19:12:14 user nova-compute[75235]:       <entry name="uuid">0547745d-4f60-430a-ad64-2607002b2c7d</entry>
Nov 29 19:12:14 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:12:14 user nova-compute[75235]:     </system>
Nov 29 19:12:14 user nova-compute[75235]:   </sysinfo>
Nov 29 19:12:14 user nova-compute[75235]:   <os>
Nov 29 19:12:14 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:12:14 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:12:14 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:12:14 user nova-compute[75235]:   </os>
Nov 29 19:12:14 user nova-compute[75235]:   <features>
Nov 29 19:12:14 user nova-compute[75235]:     <acpi/>
Nov 29 19:12:14 user nova-compute[75235]:     <apic/>
Nov 29 19:12:14 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:12:14 user nova-compute[75235]:   </features>
Nov 29 19:12:14 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:12:14 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:12:14 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:12:14 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:12:14 user nova-compute[75235]:   </clock>
Nov 29 19:12:14 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:12:14 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:12:14 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:12:14 user nova-compute[75235]:   </cpu>
Nov 29 19:12:14 user nova-compute[75235]:   <devices>
Nov 29 19:12:14 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:12:14 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:12:14 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk"/>
Nov 29 19:12:14 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:12:14 user nova-compute[75235]:     </disk>
Nov 29 19:12:14 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:12:14 user nova-compute[75235]:       <mac address="fa:16:3e:20:da:8b"/>
Nov 29 19:12:14 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:14 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:12:14 user nova-compute[75235]:       <target dev="tap1733ebcd-4c"/>
Nov 29 19:12:14 user nova-compute[75235]:     </interface>
Nov 29 19:12:14 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:12:14 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/console.log" append="off"/>
Nov 29 19:12:14 user nova-compute[75235]:     </serial>
Nov 29 19:12:14 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:12:14 user nova-compute[75235]:     <video>
Nov 29 19:12:14 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:14 user nova-compute[75235]:     </video>
Nov 29 19:12:14 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:12:14 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:12:14 user nova-compute[75235]:     </rng>
Nov 29 19:12:14 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:12:14 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:12:14 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:12:14 user nova-compute[75235]:     </memballoon>
Nov 29 19:12:14 user nova-compute[75235]:   </devices>
Nov 29 19:12:14 user nova-compute[75235]: </domain>
Nov 29 19:12:14 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861594596',display_name='tempest-VolumesActionsTest-instance-1861594596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861594596',id=30,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='876373b8352b4a98be085d0f1053226e',ramdisk_id='',reservation_id='r-rhxzc3e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1431976470',owner_user_name='tempest-VolumesActionsTest-1431976470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:12Z,user_data=None,user_id='b23af78dce5c439b85a3cd330ad40437',uuid=0547745d-4f60-430a-ad64-2607002b2c7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Converting VIF {"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG os_vif [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da19fc14-ffe2-53d9-9a93-2c7c57425063', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1733ebcd-4c, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1733ebcd-4c, col_values=(('qos', UUID('be9d3c20-82c2-4f31-bf18-4458083d6b79')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1733ebcd-4c, col_values=(('external_ids', {'iface-id': '1733ebcd-4c74-4d67-9a8c-26b667cd4a84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:da:8b', 'vm-uuid': '0547745d-4f60-430a-ad64-2607002b2c7d'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: INFO os_vif [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c')
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] No VIF found with MAC fa:16:3e:20:da:8b, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Updated VIF entry in instance network info cache for port 1733ebcd-4c74-4d67-9a8c-26b667cd4a84. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Updating instance_info_cache with network_info: [{"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b2015bbc-1401-4453-9628-399eca1de5fe req-6641403e-4c6f-4708-af65-13132d3f5a48 service nova] Releasing lock "refresh_cache-0547745d-4f60-430a-ad64-2607002b2c7d" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-98446bf9-46de-4bb6-a0d7-8f1b73864c1b req-8a8cce55-05df-48e0-94f1-4cb29cbab625 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-98446bf9-46de-4bb6-a0d7-8f1b73864c1b req-8a8cce55-05df-48e0-94f1-4cb29cbab625 service nova] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-98446bf9-46de-4bb6-a0d7-8f1b73864c1b req-8a8cce55-05df-48e0-94f1-4cb29cbab625 service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-98446bf9-46de-4bb6-a0d7-8f1b73864c1b req-8a8cce55-05df-48e0-94f1-4cb29cbab625 service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-98446bf9-46de-4bb6-a0d7-8f1b73864c1b req-8a8cce55-05df-48e0-94f1-4cb29cbab625 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] No waiting events found dispatching network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:15 user nova-compute[75235]: WARNING nova.compute.manager [req-98446bf9-46de-4bb6-a0d7-8f1b73864c1b req-8a8cce55-05df-48e0-94f1-4cb29cbab625 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received unexpected event network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 for instance with vm_state building and task_state spawning.
Nov 29 19:12:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:17 user nova-compute[75235]: INFO nova.compute.manager [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Unshelving
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'pci_requests' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'numa_topology' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:12:17 user nova-compute[75235]: INFO nova.compute.claims [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Claim successful on node user
Nov 29 19:12:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-eeec1b99-dab8-44b6-8a2b-57373fb103de req-a972e328-b1c0-4e27-af32-a8f6d9c95251 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eeec1b99-dab8-44b6-8a2b-57373fb103de req-a972e328-b1c0-4e27-af32-a8f6d9c95251 service nova] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eeec1b99-dab8-44b6-8a2b-57373fb103de req-a972e328-b1c0-4e27-af32-a8f6d9c95251 service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-eeec1b99-dab8-44b6-8a2b-57373fb103de req-a972e328-b1c0-4e27-af32-a8f6d9c95251 service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-eeec1b99-dab8-44b6-8a2b-57373fb103de req-a972e328-b1c0-4e27-af32-a8f6d9c95251 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] No waiting events found dispatching network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:17 user nova-compute[75235]: WARNING nova.compute.manager [req-eeec1b99-dab8-44b6-8a2b-57373fb103de req-a972e328-b1c0-4e27-af32-a8f6d9c95251 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received unexpected event network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 for instance with vm_state building and task_state spawning.
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:12:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Instance spawned successfully.
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:12:18 user nova-compute[75235]: INFO nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:12:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:18 user nova-compute[75235]: INFO nova.compute.manager [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Took 6.74 seconds to build instance.
Nov 29 19:12:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c8173e54-2588-4ce9-853c-d1ebb15f4fb3 tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "0547745d-4f60-430a-ad64-2607002b2c7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.833s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:18 user nova-compute[75235]: INFO nova.network.neutron [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating port d8e45ee5-1a5b-47aa-a478-93f107bf9788 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:12:19 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Creating image(s)
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'trusted_certs' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG nova.objects.base [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<20d745cf-cd85-4943-a03e-b6f9a3e0bafe> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "80da39ae67771b2e4e9f379d33592ce89cf83893" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "80da39ae67771b2e4e9f379d33592ce89cf83893" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing instance network info cache due to event network-changed-d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:12:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] Acquiring lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] Acquired lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:20 user nova-compute[75235]: DEBUG nova.network.neutron [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Refreshing network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG nova.virt.images [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] 8e1f46d6-9a0c-4695-a751-40415b26111d was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.part /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.part /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.converted" returned: 0 in 0.289s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updated VIF entry in instance network info cache for port d8e45ee5-1a5b-47aa-a478-93f107bf9788. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG nova.network.neutron [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-07abbd2e-ca9e-4b6c-8980-ec47139bcad2 req-c1a11647-8c8b-4b53-a167-72f3e2743924 service nova] Releasing lock "refresh_cache-20d745cf-cd85-4943-a03e-b6f9a3e0bafe" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "80da39ae67771b2e4e9f379d33592ce89cf83893" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.058s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "80da39ae67771b2e4e9f379d33592ce89cf83893" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "80da39ae67771b2e4e9f379d33592ce89cf83893" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893,backing_fmt=raw /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893,backing_fmt=raw /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk 1073741824" returned: 0 in 0.050s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "80da39ae67771b2e4e9f379d33592ce89cf83893" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'migration_context' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG nova.objects.base [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<20d745cf-cd85-4943-a03e-b6f9a3e0bafe> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Rebasing disk image.
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.219s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 -F raw /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 -F raw /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk" returned: 0 in 2.273s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Ensure instance console log exists: /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Start _get_guest_xml network_info=[{"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='29c48daae6108331d5f909f79c3ed6b1',container_format='bare',created_at=2023-11-29T19:10:24Z,direct_url=<?>,disk_format='qcow2',id=8e1f46d6-9a0c-4695-a751-40415b26111d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1625356192-shelved',owner='f049b77ff5714114a8808a39c57e1a94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T19:10:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:12:24 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:24 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='29c48daae6108331d5f909f79c3ed6b1',container_format='bare',created_at=2023-11-29T19:10:24Z,direct_url=<?>,disk_format='qcow2',id=8e1f46d6-9a0c-4695-a751-40415b26111d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1625356192-shelved',owner='f049b77ff5714114a8808a39c57e1a94',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T19:10:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'vcpu_model' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.objects.base [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<20d745cf-cd85-4943-a03e-b6f9a3e0bafe> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1625356192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1625356192',id=24,image_ref='8e1f46d6-9a0c-4695-a751-40415b26111d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1274433502',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-l4j9sl90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member',shelved_at='2023-11-29T19:10:29.730612',shelved_host='user',shelved_image_id='8e1f46d6-9a0c-4695-a751-40415b26111d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=20d745cf-cd85-4943-a03e-b6f9a3e0bafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'pci_devices' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.objects.base [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Object Instance<20d745cf-cd85-4943-a03e-b6f9a3e0bafe> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:12:24 user nova-compute[75235]:   <uuid>20d745cf-cd85-4943-a03e-b6f9a3e0bafe</uuid>
Nov 29 19:12:24 user nova-compute[75235]:   <name>instance-00000018</name>
Nov 29 19:12:24 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:12:24 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:12:24 user nova-compute[75235]:   <metadata>
Nov 29 19:12:24 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:12:24 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:12:24 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1625356192</nova:name>
Nov 29 19:12:24 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:12:24</nova:creationTime>
Nov 29 19:12:24 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:12:24 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:12:24 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:12:24 user nova-compute[75235]:       <nova:owner>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:user uuid="556161926cf5420b82b6f33221ac8fb4">tempest-AttachVolumeShelveTestJSON-850280898-project-member</nova:user>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:project uuid="f049b77ff5714114a8808a39c57e1a94">tempest-AttachVolumeShelveTestJSON-850280898</nova:project>
Nov 29 19:12:24 user nova-compute[75235]:       </nova:owner>
Nov 29 19:12:24 user nova-compute[75235]:       <nova:root type="image" uuid="8e1f46d6-9a0c-4695-a751-40415b26111d"/>
Nov 29 19:12:24 user nova-compute[75235]:       <nova:ports>
Nov 29 19:12:24 user nova-compute[75235]:         <nova:port uuid="d8e45ee5-1a5b-47aa-a478-93f107bf9788">
Nov 29 19:12:24 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:12:24 user nova-compute[75235]:         </nova:port>
Nov 29 19:12:24 user nova-compute[75235]:       </nova:ports>
Nov 29 19:12:24 user nova-compute[75235]:     </nova:instance>
Nov 29 19:12:24 user nova-compute[75235]:   </metadata>
Nov 29 19:12:24 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:12:24 user nova-compute[75235]:     <system>
Nov 29 19:12:24 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:12:24 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:12:24 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:12:24 user nova-compute[75235]:       <entry name="serial">20d745cf-cd85-4943-a03e-b6f9a3e0bafe</entry>
Nov 29 19:12:24 user nova-compute[75235]:       <entry name="uuid">20d745cf-cd85-4943-a03e-b6f9a3e0bafe</entry>
Nov 29 19:12:24 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:12:24 user nova-compute[75235]:     </system>
Nov 29 19:12:24 user nova-compute[75235]:   </sysinfo>
Nov 29 19:12:24 user nova-compute[75235]:   <os>
Nov 29 19:12:24 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:12:24 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:12:24 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:12:24 user nova-compute[75235]:   </os>
Nov 29 19:12:24 user nova-compute[75235]:   <features>
Nov 29 19:12:24 user nova-compute[75235]:     <acpi/>
Nov 29 19:12:24 user nova-compute[75235]:     <apic/>
Nov 29 19:12:24 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:12:24 user nova-compute[75235]:   </features>
Nov 29 19:12:24 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:12:24 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:12:24 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:12:24 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:12:24 user nova-compute[75235]:   </clock>
Nov 29 19:12:24 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:12:24 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:12:24 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:12:24 user nova-compute[75235]:   </cpu>
Nov 29 19:12:24 user nova-compute[75235]:   <devices>
Nov 29 19:12:24 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:12:24 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:12:24 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk"/>
Nov 29 19:12:24 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:12:24 user nova-compute[75235]:     </disk>
Nov 29 19:12:24 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:12:24 user nova-compute[75235]:       <mac address="fa:16:3e:a4:9a:b4"/>
Nov 29 19:12:24 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:24 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:12:24 user nova-compute[75235]:       <target dev="tapd8e45ee5-1a"/>
Nov 29 19:12:24 user nova-compute[75235]:     </interface>
Nov 29 19:12:24 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:12:24 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/console.log" append="off"/>
Nov 29 19:12:24 user nova-compute[75235]:     </serial>
Nov 29 19:12:24 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:12:24 user nova-compute[75235]:     <video>
Nov 29 19:12:24 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:24 user nova-compute[75235]:     </video>
Nov 29 19:12:24 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:12:24 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:12:24 user nova-compute[75235]:     </rng>
Nov 29 19:12:24 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:12:24 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:12:24 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:12:24 user nova-compute[75235]:     </memballoon>
Nov 29 19:12:24 user nova-compute[75235]:   </devices>
Nov 29 19:12:24 user nova-compute[75235]: </domain>
Nov 29 19:12:24 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1625356192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1625356192',id=24,image_ref='8e1f46d6-9a0c-4695-a751-40415b26111d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1274433502',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-l4j9sl90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member',shelved_at='2023-11-29T19:10:29.730612',shelved_host='user',shelved_image_id='8e1f46d6-9a0c-4695-a751-40415b26111d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=20d745cf-cd85-4943-a03e-b6f9a3e0bafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG os_vif [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dd2774a-52ff-54d7-bd1b-db43aeabb89c', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8e45ee5-1a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8e45ee5-1a, col_values=(('qos', UUID('30a26536-04ff-4489-8b95-11a705c71e4c')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8e45ee5-1a, col_values=(('external_ids', {'iface-id': 'd8e45ee5-1a5b-47aa-a478-93f107bf9788', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:9a:b4', 'vm-uuid': '20d745cf-cd85-4943-a03e-b6f9a3e0bafe'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:24 user nova-compute[75235]: INFO os_vif [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a')
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:12:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] No VIF found with MAC fa:16:3e:a4:9a:b4, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-9e9c255b-c8f4-4313-9e62-ef29beba0b3a req-141d0bdc-39cb-4957-9f9d-963767b5cbe7 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9e9c255b-c8f4-4313-9e62-ef29beba0b3a req-141d0bdc-39cb-4957-9f9d-963767b5cbe7 service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9e9c255b-c8f4-4313-9e62-ef29beba0b3a req-141d0bdc-39cb-4957-9f9d-963767b5cbe7 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9e9c255b-c8f4-4313-9e62-ef29beba0b3a req-141d0bdc-39cb-4957-9f9d-963767b5cbe7 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-9e9c255b-c8f4-4313-9e62-ef29beba0b3a req-141d0bdc-39cb-4957-9f9d-963767b5cbe7 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:26 user nova-compute[75235]: WARNING nova.compute.manager [req-9e9c255b-c8f4-4313-9e62-ef29beba0b3a req-141d0bdc-39cb-4957-9f9d-963767b5cbe7 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 19:12:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ce77d9-bcad-4f84-90ec-3a32ae9d13c8 req-f5a54491-7c00-4c10-b7cb-1b043a416ba5 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ce77d9-bcad-4f84-90ec-3a32ae9d13c8 req-f5a54491-7c00-4c10-b7cb-1b043a416ba5 service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ce77d9-bcad-4f84-90ec-3a32ae9d13c8 req-f5a54491-7c00-4c10-b7cb-1b043a416ba5 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ce77d9-bcad-4f84-90ec-3a32ae9d13c8 req-f5a54491-7c00-4c10-b7cb-1b043a416ba5 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ce77d9-bcad-4f84-90ec-3a32ae9d13c8 req-f5a54491-7c00-4c10-b7cb-1b043a416ba5 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:28 user nova-compute[75235]: WARNING nova.compute.manager [req-76ce77d9-bcad-4f84-90ec-3a32ae9d13c8 req-f5a54491-7c00-4c10-b7cb-1b043a416ba5 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 19:12:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:12:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:12:29 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance spawned successfully.
Nov 29 19:12:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:12:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1c7ff0a4-52c9-4ede-98be-320b0e1ac8e4 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.837s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Port 644e59e3-44e4-43e5-8d47-a226b1457182 binding to destination host user is already ACTIVE {{(pid=75235) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Creating tmpfile /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/tmpofr4no4z to verify with other compute node that the instance is on the same shared storage. {{(pid=75235) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-c0ecb917-856e-447a-ad28-9d98c53b5f47 req-cba21110-2cd4-4eda-9c7b-b85be2789a27 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c0ecb917-856e-447a-ad28-9d98c53b5f47 req-cba21110-2cd4-4eda-9c7b-b85be2789a27 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c0ecb917-856e-447a-ad28-9d98c53b5f47 req-cba21110-2cd4-4eda-9c7b-b85be2789a27 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c0ecb917-856e-447a-ad28-9d98c53b5f47 req-cba21110-2cd4-4eda-9c7b-b85be2789a27 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-c0ecb917-856e-447a-ad28-9d98c53b5f47 req-cba21110-2cd4-4eda-9c7b-b85be2789a27 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:32 user nova-compute[75235]: WARNING nova.compute.manager [req-c0ecb917-856e-447a-ad28-9d98c53b5f47 req-cba21110-2cd4-4eda-9c7b-b85be2789a27 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance destroyed successfully.
Nov 29 19:12:33 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'resources' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap644e59e3-44, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=273cbe63-75db-4290-9c7e-fa94fa6492cd) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:33 user nova-compute[75235]: INFO os_vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44')
Nov 29 19:12:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:33 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[75176e7c-9f66-4677-aabd-5b4d94aa22d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:12:33 user nova-compute[75235]: No targets found.
Nov 29 19:12:33 user nova-compute[75235]: iSNS:
Nov 29 19:12:33 user nova-compute[75235]: No targets found.
Nov 29 19:12:33 user nova-compute[75235]: STATIC:
Nov 29 19:12:33 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033
Nov 29 19:12:33 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:12:33 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:12:33 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:12:33 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:12:33 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:12:33 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e
Nov 29 19:12:33 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:12:33 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:12:33 user nova-compute[75235]: FIRMWARE:
Nov 29 19:12:33 user nova-compute[75235]: No targets found.
Nov 29 19:12:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:12:33 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:12:33 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[61068782-2b1e-4bdc-8f21-2fc408c9412d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db65744-2fa3-4018-bb86-a42e78035ad6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:33 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:33 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:33 user nova-compute[75235]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:33 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565052c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec53de5d-06f3-465a-b408-2d6d9cadebcf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[634eb515-b50d-4e19-bf7d-ab97b1dfb665]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c9eef-1fef-4a01-a09b-ba2af13ba988]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd5b7ed-c48f-4b16-94e1-79c8fc039e10]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df0697-0578-4d33-8475-881203c7334f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ae2275-ee86-413a-9ad1-ecf76ba4dfbb]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]
Nov 29 19:12:33 user nova-compute[75235]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.
Nov 29 19:12:33 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c14b28-2e4b-4e38-be7f-6a8989dc49df]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== disconnect_volume: return (370ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:34 user nova-compute[75235]: WARNING nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:34 user nova-compute[75235]: WARNING nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:34 user nova-compute[75235]: WARNING nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:34 user nova-compute[75235]: WARNING nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:34 user nova-compute[75235]: WARNING nova.compute.manager [req-7e42485e-68f2-4ce8-ad65-63e5a1d3736f req-6bf49f05-b638-4728-a845-b65f65d84278 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'migration_context' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG nova.objects.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Object Instance<667a5ca0-f308-4eb9-a025-14c49ff25eb3> lazy-loaded attributes: resources,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.489s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:35 user nova-compute[75235]: INFO nova.compute.manager [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Swapping old allocation on dict_keys(['5d984797-93a3-43d0-9a35-bb500b1e869a']) held by migration 53c6c408-fac2-43cc-abd9-e97c057c78bb for instance
Nov 29 19:12:35 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Overwriting current allocation {'allocations': {'5d984797-93a3-43d0-9a35-bb500b1e869a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 37}}, 'project_id': '52ccc9827eb540868fea8b5891c75338', 'user_id': 'b1fe2271d5ad4b97acdbfcd699e3829a', 'consumer_generation': 1} on consumer 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquired lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Releasing lock "refresh_cache-667a5ca0-f308-4eb9-a025-14c49ff25eb3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG os_brick.utils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d36ef-3d31-4a71-9b38-5fdaeaae5e78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[755efa3b-3d0e-455c-939a-38d263a2e695]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e02fd-bc82-40dc-a18a-bcf7b4614017]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f3a2ce-b7f9-47d8-b637-11ea411e7654]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:12:36 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:12:36 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[36332a9d-9eba-417b-82b9-dee709a54b37]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:12:36 user nova-compute[75235]: DEBUG os_brick.utils [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:12:44 user nova-compute[75235]: INFO nova.compute.claims [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Claim successful on node user
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Starting finish_revert_migration {{(pid=75235) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start _get_guest_xml network_info=[{"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '65d27db8-f858-4852-aeb1-9f7763ee2e5c', 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '667a5ca0-f308-4eb9-a025-14c49ff25eb3', 'attached_at': '2023-11-29T19:12:45.000000', 'detached_at': '', 'volume_id': 'c4801896-ec3b-4de0-b0e7-132535a07033', 'serial': 'c4801896-ec3b-4de0-b0e7-132535a07033'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:12:45 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:45 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'vcpu_model' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:45 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:45 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:45 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd9994-2b85-4809-90a3-07978f54ae47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:12:45 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b318b93a-118a-4486-976e-bab999fbaad3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033] added
Nov 29 19:12:45 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c82676-c407-49ae-bd4a-b4a25b62a46d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74a2f8-7de1-4143-b0af-b91437418c33]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLWeznm {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RiLWeznm" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ece77f-48f6-4ac2-9985-9447f7e6c730]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RiLWeznm'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7549bb1d-fcbc-4f99-81d1-c42d88bef332]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca19d4-608f-4ce0-89ca-19041ccf2d69]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:45 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:45 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:45 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:45 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.policy [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d98bb13233f447295cf54cb5b1574e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68dafa45545c46169abd1cad11ba15cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:12:45 user nova-compute[75235]: INFO nova.virt.block_device [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Booting with volume 2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 at /dev/vda
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[975aa340-8487-4033-95de-83894f1ad32e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]
Nov 29 19:12:45 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.
Nov 29 19:12:45 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae875dc-50c5-4c6a-b84b-49e32e4d2895]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.utils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f788e6-bb93-41a5-b5c8-215b64182aa6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:45 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:45 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:45 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:45 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:45 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:45 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e7c61-9a9b-4557-b4b3-7d673df0021f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f81afa-7a62-47b7-abf3-51fb0db085a7]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bfa968-6cae-41e2-8e6f-48187d176718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a40c2-a5f8-4445-95e1-f7e405f4fcd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a421b7a5-e377-417c-8923-33d3e56db61e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:12:45 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:12:45 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[700de3fe-4abe-4962-92df-1757f8750328]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG os_brick.utils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:45 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating existing volume attachment record: f3746abb-6c26-43f4-9997-e8a9ac068490 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Successfully created port: 5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26635353963626431', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635353963626431', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:12:46 user nova-compute[75235]:   <uuid>667a5ca0-f308-4eb9-a025-14c49ff25eb3</uuid>
Nov 29 19:12:46 user nova-compute[75235]:   <name>instance-00000014</name>
Nov 29 19:12:46 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:12:46 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:12:46 user nova-compute[75235]:   <metadata>
Nov 29 19:12:46 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:12:46 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:12:46 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherB-server-2026348765</nova:name>
Nov 29 19:12:46 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:12:45</nova:creationTime>
Nov 29 19:12:46 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:12:46 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:12:46 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:12:46 user nova-compute[75235]:       <nova:owner>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:user uuid="b1fe2271d5ad4b97acdbfcd699e3829a">tempest-ServerActionsTestOtherB-1405811153-project-member</nova:user>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:project uuid="52ccc9827eb540868fea8b5891c75338">tempest-ServerActionsTestOtherB-1405811153</nova:project>
Nov 29 19:12:46 user nova-compute[75235]:       </nova:owner>
Nov 29 19:12:46 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:12:46 user nova-compute[75235]:       <nova:ports>
Nov 29 19:12:46 user nova-compute[75235]:         <nova:port uuid="644e59e3-44e4-43e5-8d47-a226b1457182">
Nov 29 19:12:46 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 19:12:46 user nova-compute[75235]:         </nova:port>
Nov 29 19:12:46 user nova-compute[75235]:       </nova:ports>
Nov 29 19:12:46 user nova-compute[75235]:     </nova:instance>
Nov 29 19:12:46 user nova-compute[75235]:   </metadata>
Nov 29 19:12:46 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:12:46 user nova-compute[75235]:     <system>
Nov 29 19:12:46 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:12:46 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:12:46 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:12:46 user nova-compute[75235]:       <entry name="serial">667a5ca0-f308-4eb9-a025-14c49ff25eb3</entry>
Nov 29 19:12:46 user nova-compute[75235]:       <entry name="uuid">667a5ca0-f308-4eb9-a025-14c49ff25eb3</entry>
Nov 29 19:12:46 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:12:46 user nova-compute[75235]:     </system>
Nov 29 19:12:46 user nova-compute[75235]:   </sysinfo>
Nov 29 19:12:46 user nova-compute[75235]:   <os>
Nov 29 19:12:46 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:12:46 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:12:46 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:12:46 user nova-compute[75235]:   </os>
Nov 29 19:12:46 user nova-compute[75235]:   <features>
Nov 29 19:12:46 user nova-compute[75235]:     <acpi/>
Nov 29 19:12:46 user nova-compute[75235]:     <apic/>
Nov 29 19:12:46 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:12:46 user nova-compute[75235]:   </features>
Nov 29 19:12:46 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:12:46 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:12:46 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:12:46 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:12:46 user nova-compute[75235]:   </clock>
Nov 29 19:12:46 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:12:46 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:12:46 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:12:46 user nova-compute[75235]:   </cpu>
Nov 29 19:12:46 user nova-compute[75235]:   <devices>
Nov 29 19:12:46 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:12:46 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:12:46 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk"/>
Nov 29 19:12:46 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:12:46 user nova-compute[75235]:     </disk>
Nov 29 19:12:46 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:12:46 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:12:46 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:12:46 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:12:46 user nova-compute[75235]:       <serial>c4801896-ec3b-4de0-b0e7-132535a07033</serial>
Nov 29 19:12:46 user nova-compute[75235]:     </disk>
Nov 29 19:12:46 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:12:46 user nova-compute[75235]:       <mac address="fa:16:3e:b2:6a:b3"/>
Nov 29 19:12:46 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:46 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:12:46 user nova-compute[75235]:       <target dev="tap644e59e3-44"/>
Nov 29 19:12:46 user nova-compute[75235]:     </interface>
Nov 29 19:12:46 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:12:46 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/console.log" append="off"/>
Nov 29 19:12:46 user nova-compute[75235]:     </serial>
Nov 29 19:12:46 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:12:46 user nova-compute[75235]:     <video>
Nov 29 19:12:46 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:46 user nova-compute[75235]:     </video>
Nov 29 19:12:46 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:12:46 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:12:46 user nova-compute[75235]:     </rng>
Nov 29 19:12:46 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:12:46 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:12:46 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:12:46 user nova-compute[75235]:     </memballoon>
Nov 29 19:12:46 user nova-compute[75235]:   </devices>
Nov 29 19:12:46 user nova-compute[75235]: </domain>
Nov 29 19:12:46 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG os_vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfe2b9fa-0f48-5676-be48-63a3859e3c28', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Successfully updated port: 5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap644e59e3-44, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap644e59e3-44, col_values=(('qos', UUID('0fdd05f6-4a60-42a2-9e53-ba976d2ea454')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap644e59e3-44, col_values=(('external_ids', {'iface-id': '644e59e3-44e4-43e5-8d47-a226b1457182', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:6a:b3', 'vm-uuid': '667a5ca0-f308-4eb9-a025-14c49ff25eb3'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:46 user nova-compute[75235]: INFO os_vif [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44')
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-changed-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Refreshing instance network info cache due to event network-changed-5c2159e5-c7e8-46d3-b968-533f0415b437. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:12:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance network_info: |[{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Refreshing network info cache for port 5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updated VIF entry in instance network info cache for port 5c2159e5-c7e8-46d3-b968-533f0415b437. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG nova.network.neutron [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:12:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1dffe0e7-2436-4b90-b561-000beb35f693 req-5b79a3ab-162c-4717-b2f8-15f5b44a661c service nova] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-4f394ad3-4d72-4f79-ab77-58da17be8ad4 req-91d8fc39-e617-4eed-8f1f-22b80ca86263 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4f394ad3-4d72-4f79-ab77-58da17be8ad4 req-91d8fc39-e617-4eed-8f1f-22b80ca86263 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4f394ad3-4d72-4f79-ab77-58da17be8ad4 req-91d8fc39-e617-4eed-8f1f-22b80ca86263 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4f394ad3-4d72-4f79-ab77-58da17be8ad4 req-91d8fc39-e617-4eed-8f1f-22b80ca86263 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-4f394ad3-4d72-4f79-ab77-58da17be8ad4 req-91d8fc39-e617-4eed-8f1f-22b80ca86263 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:48 user nova-compute[75235]: WARNING nova.compute.manager [req-4f394ad3-4d72-4f79-ab77-58da17be8ad4 req-91d8fc39-e617-4eed-8f1f-22b80ca86263 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:50 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:12:50 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance running successfully.
Nov 29 19:12:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] finish_revert_migration finished successfully. {{(pid=75235) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 19:12:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5d68697-1bee-4a4f-bd70-6a191f3f5fa9 req-a91511ea-a3e9-4323-85d1-58c8031f8a17 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5d68697-1bee-4a4f-bd70-6a191f3f5fa9 req-a91511ea-a3e9-4323-85d1-58c8031f8a17 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5d68697-1bee-4a4f-bd70-6a191f3f5fa9 req-a91511ea-a3e9-4323-85d1-58c8031f8a17 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5d68697-1bee-4a4f-bd70-6a191f3f5fa9 req-a91511ea-a3e9-4323-85d1-58c8031f8a17 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5d68697-1bee-4a4f-bd70-6a191f3f5fa9 req-a91511ea-a3e9-4323-85d1-58c8031f8a17 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:50 user nova-compute[75235]: WARNING nova.compute.manager [req-e5d68697-1bee-4a4f-bd70-6a191f3f5fa9 req-a91511ea-a3e9-4323-85d1-58c8031f8a17 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state resized and task_state resize_reverting.
Nov 29 19:12:50 user nova-compute[75235]: INFO nova.compute.manager [None req-d3bc2883-829c-4688-aefa-57466e45df02 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance to original state: 'active'
Nov 29 19:12:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:12:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Creating image(s)
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Ensure instance console log exists: /opt/stack/data/nova/instances/a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Start _get_guest_xml network_info=[{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f3746abb-6c26-43f4-9997-e8a9ac068490', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487', 'attached_at': '', 'detached_at': '', 'volume_id': '2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'serial': '2f19bd84-5ddf-4b43-bc69-ea4c56d21d06'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:12:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:12:54 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:54 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:12:54 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:12:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac418da6-1ed0-4e29-a296-2dd5c512ad54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:12:54 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d03353-ddf1-4158-b208-62a64cdb1d45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06] added
Nov 29 19:12:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c6983-f5fa-4a08-b19e-c7172eae4fdf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c636f-0a18-43a4-bd82-06150940204a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGPzjvd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGPzjvd" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc6a16-e1c7-413d-b991-cc0eee7342a0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUGPzjvd'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce3ca96-62c1-4a57-906d-3318a7e84501]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dc5339-0877-4435-b9c0-c703a0460105]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e712f07-18c2-49ff-8706-3cda9809ac47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]
Nov 29 19:12:54 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.
Nov 29 19:12:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760a85e-6439-4da5-a7db-f420ca2b0dce]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afafdf-e5d5-4da0-91e6-05e279479c4d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:12:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d511e4f-9068-4148-ad2a-e19661e40505]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:12:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23461393539383161', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461393539383161', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268210074',display_name='tempest-ServerActionsTestOtherA-server-268210074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268210074',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-7ve0syrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'pci_devices' on Instance uuid a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:12:55 user nova-compute[75235]:   <uuid>a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487</uuid>
Nov 29 19:12:55 user nova-compute[75235]:   <name>instance-0000001f</name>
Nov 29 19:12:55 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:12:55 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:12:55 user nova-compute[75235]:   <metadata>
Nov 29 19:12:55 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:12:55 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:12:55 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherA-server-268210074</nova:name>
Nov 29 19:12:55 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:12:54</nova:creationTime>
Nov 29 19:12:55 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:12:55 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:12:55 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:12:55 user nova-compute[75235]:       <nova:owner>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:user uuid="1d98bb13233f447295cf54cb5b1574e8">tempest-ServerActionsTestOtherA-279549641-project-member</nova:user>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:project uuid="68dafa45545c46169abd1cad11ba15cc">tempest-ServerActionsTestOtherA-279549641</nova:project>
Nov 29 19:12:55 user nova-compute[75235]:       </nova:owner>
Nov 29 19:12:55 user nova-compute[75235]:       <nova:ports>
Nov 29 19:12:55 user nova-compute[75235]:         <nova:port uuid="5c2159e5-c7e8-46d3-b968-533f0415b437">
Nov 29 19:12:55 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:12:55 user nova-compute[75235]:         </nova:port>
Nov 29 19:12:55 user nova-compute[75235]:       </nova:ports>
Nov 29 19:12:55 user nova-compute[75235]:     </nova:instance>
Nov 29 19:12:55 user nova-compute[75235]:   </metadata>
Nov 29 19:12:55 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:12:55 user nova-compute[75235]:     <system>
Nov 29 19:12:55 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:12:55 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:12:55 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:12:55 user nova-compute[75235]:       <entry name="serial">a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487</entry>
Nov 29 19:12:55 user nova-compute[75235]:       <entry name="uuid">a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487</entry>
Nov 29 19:12:55 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:12:55 user nova-compute[75235]:     </system>
Nov 29 19:12:55 user nova-compute[75235]:   </sysinfo>
Nov 29 19:12:55 user nova-compute[75235]:   <os>
Nov 29 19:12:55 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:12:55 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:12:55 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:12:55 user nova-compute[75235]:   </os>
Nov 29 19:12:55 user nova-compute[75235]:   <features>
Nov 29 19:12:55 user nova-compute[75235]:     <acpi/>
Nov 29 19:12:55 user nova-compute[75235]:     <apic/>
Nov 29 19:12:55 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:12:55 user nova-compute[75235]:   </features>
Nov 29 19:12:55 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:12:55 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:12:55 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:12:55 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:12:55 user nova-compute[75235]:   </clock>
Nov 29 19:12:55 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:12:55 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:12:55 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:12:55 user nova-compute[75235]:   </cpu>
Nov 29 19:12:55 user nova-compute[75235]:   <devices>
Nov 29 19:12:55 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:12:55 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:12:55 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:12:55 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:12:55 user nova-compute[75235]:       <serial>2f19bd84-5ddf-4b43-bc69-ea4c56d21d06</serial>
Nov 29 19:12:55 user nova-compute[75235]:     </disk>
Nov 29 19:12:55 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:12:55 user nova-compute[75235]:       <mac address="fa:16:3e:93:cd:6a"/>
Nov 29 19:12:55 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:55 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:12:55 user nova-compute[75235]:       <target dev="tap5c2159e5-c7"/>
Nov 29 19:12:55 user nova-compute[75235]:     </interface>
Nov 29 19:12:55 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:12:55 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487/console.log" append="off"/>
Nov 29 19:12:55 user nova-compute[75235]:     </serial>
Nov 29 19:12:55 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:12:55 user nova-compute[75235]:     <video>
Nov 29 19:12:55 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:12:55 user nova-compute[75235]:     </video>
Nov 29 19:12:55 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:12:55 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:12:55 user nova-compute[75235]:     </rng>
Nov 29 19:12:55 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:12:55 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:12:55 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:12:55 user nova-compute[75235]:     </memballoon>
Nov 29 19:12:55 user nova-compute[75235]:   </devices>
Nov 29 19:12:55 user nova-compute[75235]: </domain>
Nov 29 19:12:55 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268210074',display_name='tempest-ServerActionsTestOtherA-server-268210074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268210074',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-7ve0syrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG os_vif [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38622916-814a-5dd8-92b6-4ed200b7ad24', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2159e5-c7, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c2159e5-c7, col_values=(('qos', UUID('4f96ac3e-06af-456e-9da4-581ce501972e')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c2159e5-c7, col_values=(('external_ids', {'iface-id': '5c2159e5-c7e8-46d3-b968-533f0415b437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:cd:6a', 'vm-uuid': 'a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:55 user nova-compute[75235]: INFO os_vif [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7')
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:12:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No VIF found with MAC fa:16:3e:93:cd:6a, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-d71a37aa-1131-4e14-8f66-646fddc5d965 req-a69af156-00e8-4245-8bb2-ba88b0b7e37e service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d71a37aa-1131-4e14-8f66-646fddc5d965 req-a69af156-00e8-4245-8bb2-ba88b0b7e37e service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d71a37aa-1131-4e14-8f66-646fddc5d965 req-a69af156-00e8-4245-8bb2-ba88b0b7e37e service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d71a37aa-1131-4e14-8f66-646fddc5d965 req-a69af156-00e8-4245-8bb2-ba88b0b7e37e service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-d71a37aa-1131-4e14-8f66-646fddc5d965 req-a69af156-00e8-4245-8bb2-ba88b0b7e37e service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:12:57 user nova-compute[75235]: WARNING nova.compute.manager [req-d71a37aa-1131-4e14-8f66-646fddc5d965 req-a69af156-00e8-4245-8bb2-ba88b0b7e37e service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state building and task_state spawning.
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:12:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-d58b2ab5-d1e4-446a-9f39-9e2431f5d989 req-05e253d6-fc19-4c0e-886c-56fe285076f0 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d58b2ab5-d1e4-446a-9f39-9e2431f5d989 req-05e253d6-fc19-4c0e-886c-56fe285076f0 service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d58b2ab5-d1e4-446a-9f39-9e2431f5d989 req-05e253d6-fc19-4c0e-886c-56fe285076f0 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d58b2ab5-d1e4-446a-9f39-9e2431f5d989 req-05e253d6-fc19-4c0e-886c-56fe285076f0 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-d58b2ab5-d1e4-446a-9f39-9e2431f5d989 req-05e253d6-fc19-4c0e-886c-56fe285076f0 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:00 user nova-compute[75235]: WARNING nova.compute.manager [req-d58b2ab5-d1e4-446a-9f39-9e2431f5d989 req-05e253d6-fc19-4c0e-886c-56fe285076f0 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state building and task_state spawning.
Nov 29 19:13:00 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:13:00 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=25.068828582763672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance spawned successfully.
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:00 user nova-compute[75235]: INFO nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0547745d-4f60-430a-ad64-2607002b2c7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 20d745cf-cd85-4943-a03e-b6f9a3e0bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:13:00 user nova-compute[75235]: INFO nova.compute.manager [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Took 15.61 seconds to build instance.
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3ec19989-98cc-4e95-b5d7-d4eea9514c86 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.738s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:02 user nova-compute[75235]: INFO nova.compute.manager [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Terminating instance
Nov 29 19:13:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:13:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-cb089e86-58b3-4429-bc24-f7a248303775 req-fd3aaab8-eea3-470c-81bc-63cb807e62cf service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-unplugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cb089e86-58b3-4429-bc24-f7a248303775 req-fd3aaab8-eea3-470c-81bc-63cb807e62cf service nova] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cb089e86-58b3-4429-bc24-f7a248303775 req-fd3aaab8-eea3-470c-81bc-63cb807e62cf service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cb089e86-58b3-4429-bc24-f7a248303775 req-fd3aaab8-eea3-470c-81bc-63cb807e62cf service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-cb089e86-58b3-4429-bc24-f7a248303775 req-fd3aaab8-eea3-470c-81bc-63cb807e62cf service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] No waiting events found dispatching network-vif-unplugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-cb089e86-58b3-4429-bc24-f7a248303775 req-fd3aaab8-eea3-470c-81bc-63cb807e62cf service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-unplugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Instance destroyed successfully.
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lazy-loading 'resources' on Instance uuid 8abc39f4-4d73-4a69-8acb-d87fe3871867 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1736147809',display_name='tempest-ServersNegativeTestJSON-server-1736147809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1736147809',id=13,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:04:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='094885e7831048339ba2cdddd4c67a25',ramdisk_id='',reservation_id='r-wqlsnoid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1781487510',owner_user_name='tempest-ServersNegativeTestJSON-1781487510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:04:19Z,user_data=None,user_id='09c7bffe8af741b1b1f2542f543d20e4',uuid=8abc39f4-4d73-4a69-8acb-d87fe3871867,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converting VIF {"id": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "address": "fa:16:3e:17:f8:18", "network": {"id": "bd2158e2-540a-4b7e-adb6-d80d4632ca17", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-482816442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "094885e7831048339ba2cdddd4c67a25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91dad61-a5", "ovs_interfaceid": "e91dad61-a5dd-4c4a-b070-24b33ea61bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG os_vif [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape91dad61-a5, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64bc2066-3060-48d5-9903-7263ed98352a) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:13:03 user nova-compute[75235]: INFO os_vif [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:f8:18,bridge_name='br-int',has_traffic_filtering=True,id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6,network=Network(bd2158e2-540a-4b7e-adb6-d80d4632ca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape91dad61-a5')
Nov 29 19:13:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Deleting instance files /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867_del
Nov 29 19:13:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Deletion of /opt/stack/data/nova/instances/8abc39f4-4d73-4a69-8acb-d87fe3871867_del complete
Nov 29 19:13:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:03 user nova-compute[75235]: INFO nova.compute.manager [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 29 19:13:03 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:13:03 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:13:04 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Took 0.82 seconds to deallocate network for instance.
Nov 29 19:13:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-623272f1-2758-4aee-8c6e-bfde91f8b7f5 req-c85ece1a-fcc0-4057-a8ad-df2e0d2e30d8 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-deleted-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:04 user nova-compute[75235]: INFO nova.compute.manager [req-623272f1-2758-4aee-8c6e-bfde91f8b7f5 req-c85ece1a-fcc0-4057-a8ad-df2e0d2e30d8 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Neutron deleted interface e91dad61-a5dd-4c4a-b070-24b33ea61bf6; detaching it from the instance and deleting it from the info cache
Nov 29 19:13:04 user nova-compute[75235]: DEBUG nova.network.neutron [req-623272f1-2758-4aee-8c6e-bfde91f8b7f5 req-c85ece1a-fcc0-4057-a8ad-df2e0d2e30d8 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-623272f1-2758-4aee-8c6e-bfde91f8b7f5 req-c85ece1a-fcc0-4057-a8ad-df2e0d2e30d8 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Detach interface failed, port_id=e91dad61-a5dd-4c4a-b070-24b33ea61bf6, reason: Instance 8abc39f4-4d73-4a69-8acb-d87fe3871867 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:04 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:05 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Deleted allocations for instance 8abc39f4-4d73-4a69-8acb-d87fe3871867
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] No waiting events found dispatching network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:05 user nova-compute[75235]: WARNING nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received unexpected event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 for instance with vm_state deleted and task_state None.
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] No waiting events found dispatching network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:05 user nova-compute[75235]: WARNING nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received unexpected event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 for instance with vm_state deleted and task_state None.
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Acquiring lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] No waiting events found dispatching network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:05 user nova-compute[75235]: WARNING nova.compute.manager [req-5654fc01-d508-4be5-a425-2ee405352b9d req-dc156479-9c1c-4172-b488-20feaff75374 service nova] [instance: 8abc39f4-4d73-4a69-8acb-d87fe3871867] Received unexpected event network-vif-plugged-e91dad61-a5dd-4c4a-b070-24b33ea61bf6 for instance with vm_state deleted and task_state None.
Nov 29 19:13:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1edfa3f4-6130-417b-8430-1a93e04bdad7 tempest-ServersNegativeTestJSON-1781487510 tempest-ServersNegativeTestJSON-1781487510-project-member] Lock "8abc39f4-4d73-4a69-8acb-d87fe3871867" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.571s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:31 user nova-compute[75235]: INFO nova.compute.manager [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Unrescuing
Nov 29 19:13:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:13:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:13:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'flavor' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec6989e0-674b-43a2-9d45-85951d3b07ac req-952032ec-750a-4057-a2db-cd3db51cdcce service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec6989e0-674b-43a2-9d45-85951d3b07ac req-952032ec-750a-4057-a2db-cd3db51cdcce service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec6989e0-674b-43a2-9d45-85951d3b07ac req-952032ec-750a-4057-a2db-cd3db51cdcce service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ec6989e0-674b-43a2-9d45-85951d3b07ac req-952032ec-750a-4057-a2db-cd3db51cdcce service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-ec6989e0-674b-43a2-9d45-85951d3b07ac req-952032ec-750a-4057-a2db-cd3db51cdcce service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:32 user nova-compute[75235]: WARNING nova.compute.manager [req-ec6989e0-674b-43a2-9d45-85951d3b07ac req-952032ec-750a-4057-a2db-cd3db51cdcce service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:13:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:32 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance destroyed successfully.
Nov 29 19:13:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-8a572ecb-6bb8-42ad-84bc-eee8e4ffd8b1 req-4506beac-9b1a-4789-b459-1423da282e9e service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8a572ecb-6bb8-42ad-84bc-eee8e4ffd8b1 req-4506beac-9b1a-4789-b459-1423da282e9e service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8a572ecb-6bb8-42ad-84bc-eee8e4ffd8b1 req-4506beac-9b1a-4789-b459-1423da282e9e service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8a572ecb-6bb8-42ad-84bc-eee8e4ffd8b1 req-4506beac-9b1a-4789-b459-1423da282e9e service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-8a572ecb-6bb8-42ad-84bc-eee8e4ffd8b1 req-4506beac-9b1a-4789-b459-1423da282e9e service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:34 user nova-compute[75235]: WARNING nova.compute.manager [req-8a572ecb-6bb8-42ad-84bc-eee8e4ffd8b1 req-4506beac-9b1a-4789-b459-1423da282e9e service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:13:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:36 user nova-compute[75235]: WARNING nova.compute.manager [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:13:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:36 user nova-compute[75235]: WARNING nova.compute.manager [req-65d3ff70-e162-411d-bed5-c040e4926633 req-fc9e242c-fe27-4066-b458-9d49b9f50b32 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:13:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7e24691d-2c9f-4859-8b12-bff71e820a2e tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:13:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:13:42 user nova-compute[75235]: INFO nova.compute.claims [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Claim successful on node user
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:13:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.policy [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ef2c4e50a09485f99d6f132c4857491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf499ae51bcf4e1592cac24df33ff6ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:13:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Creating image(s)
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "/opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "/opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk 1073741824" returned: 0 in 0.049s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Successfully created port: 0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Cannot resize image /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Ensure instance console log exists: /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Successfully updated port: 0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquired lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-changed-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Refreshing instance network info cache due to event network-changed-0140779b-6c22-42a4-a580-f41c9098ab4e. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] Acquiring lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updating instance_info_cache with network_info: [{"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Releasing lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Instance network_info: |[{"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] Acquired lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Refreshing network info cache for port 0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Start _get_guest_xml network_info=[{"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:13:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:13:44 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-652622122',display_name='tempest-TestServerVolumeAttachmentScenario-server-652622122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-652622122',id=32,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMczScZup3A7TjDxjd3laaqATiuxS0B8QPWG0L4pVwkjQrc+KA157tSSyCebqlOQoLazvKWJu61eWMAJd/rhXFAhmQzAhlbs49QuaBLd4e20mIFq5HfDRH5CJWdlYJLJlQ==',key_name='tempest-keypair-1413679644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf499ae51bcf4e1592cac24df33ff6ea',ramdisk_id='',reservation_id='r-b0s2ppke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-432609267',owner_user_name='tempest-TestServerVolumeAttachmentScenario-432609267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ef2c4e50a09485f99d6f132c4857491',uuid=8d3d1884-0135-490c-bca5-1672b8d64884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Converting VIF {"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:13:44 user nova-compute[75235]:   <uuid>8d3d1884-0135-490c-bca5-1672b8d64884</uuid>
Nov 29 19:13:44 user nova-compute[75235]:   <name>instance-00000020</name>
Nov 29 19:13:44 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:13:44 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:13:44 user nova-compute[75235]:   <metadata>
Nov 29 19:13:44 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:13:44 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:13:44 user nova-compute[75235]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-652622122</nova:name>
Nov 29 19:13:44 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:13:44</nova:creationTime>
Nov 29 19:13:44 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:13:44 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:13:44 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:13:44 user nova-compute[75235]:       <nova:owner>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:user uuid="4ef2c4e50a09485f99d6f132c4857491">tempest-TestServerVolumeAttachmentScenario-432609267-project-member</nova:user>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:project uuid="bf499ae51bcf4e1592cac24df33ff6ea">tempest-TestServerVolumeAttachmentScenario-432609267</nova:project>
Nov 29 19:13:44 user nova-compute[75235]:       </nova:owner>
Nov 29 19:13:44 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:13:44 user nova-compute[75235]:       <nova:ports>
Nov 29 19:13:44 user nova-compute[75235]:         <nova:port uuid="0140779b-6c22-42a4-a580-f41c9098ab4e">
Nov 29 19:13:44 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 19:13:44 user nova-compute[75235]:         </nova:port>
Nov 29 19:13:44 user nova-compute[75235]:       </nova:ports>
Nov 29 19:13:44 user nova-compute[75235]:     </nova:instance>
Nov 29 19:13:44 user nova-compute[75235]:   </metadata>
Nov 29 19:13:44 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:13:44 user nova-compute[75235]:     <system>
Nov 29 19:13:44 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:13:44 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:13:44 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:13:44 user nova-compute[75235]:       <entry name="serial">8d3d1884-0135-490c-bca5-1672b8d64884</entry>
Nov 29 19:13:44 user nova-compute[75235]:       <entry name="uuid">8d3d1884-0135-490c-bca5-1672b8d64884</entry>
Nov 29 19:13:44 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:13:44 user nova-compute[75235]:     </system>
Nov 29 19:13:44 user nova-compute[75235]:   </sysinfo>
Nov 29 19:13:44 user nova-compute[75235]:   <os>
Nov 29 19:13:44 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:13:44 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:13:44 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:13:44 user nova-compute[75235]:   </os>
Nov 29 19:13:44 user nova-compute[75235]:   <features>
Nov 29 19:13:44 user nova-compute[75235]:     <acpi/>
Nov 29 19:13:44 user nova-compute[75235]:     <apic/>
Nov 29 19:13:44 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:13:44 user nova-compute[75235]:   </features>
Nov 29 19:13:44 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:13:44 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:13:44 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:13:44 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:13:44 user nova-compute[75235]:   </clock>
Nov 29 19:13:44 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:13:44 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:13:44 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:13:44 user nova-compute[75235]:   </cpu>
Nov 29 19:13:44 user nova-compute[75235]:   <devices>
Nov 29 19:13:44 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:13:44 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:13:44 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk"/>
Nov 29 19:13:44 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:13:44 user nova-compute[75235]:     </disk>
Nov 29 19:13:44 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:13:44 user nova-compute[75235]:       <mac address="fa:16:3e:ad:80:4e"/>
Nov 29 19:13:44 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:13:44 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:13:44 user nova-compute[75235]:       <target dev="tap0140779b-6c"/>
Nov 29 19:13:44 user nova-compute[75235]:     </interface>
Nov 29 19:13:44 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:13:44 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/console.log" append="off"/>
Nov 29 19:13:44 user nova-compute[75235]:     </serial>
Nov 29 19:13:44 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:13:44 user nova-compute[75235]:     <video>
Nov 29 19:13:44 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:13:44 user nova-compute[75235]:     </video>
Nov 29 19:13:44 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:13:44 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:13:44 user nova-compute[75235]:     </rng>
Nov 29 19:13:44 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:13:44 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:13:44 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:13:44 user nova-compute[75235]:     </memballoon>
Nov 29 19:13:44 user nova-compute[75235]:   </devices>
Nov 29 19:13:44 user nova-compute[75235]: </domain>
Nov 29 19:13:44 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-652622122',display_name='tempest-TestServerVolumeAttachmentScenario-server-652622122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-652622122',id=32,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMczScZup3A7TjDxjd3laaqATiuxS0B8QPWG0L4pVwkjQrc+KA157tSSyCebqlOQoLazvKWJu61eWMAJd/rhXFAhmQzAhlbs49QuaBLd4e20mIFq5HfDRH5CJWdlYJLJlQ==',key_name='tempest-keypair-1413679644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf499ae51bcf4e1592cac24df33ff6ea',ramdisk_id='',reservation_id='r-b0s2ppke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-432609267',owner_user_name='tempest-TestServerVolumeAttachmentScenario-432609267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ef2c4e50a09485f99d6f132c4857491',uuid=8d3d1884-0135-490c-bca5-1672b8d64884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Converting VIF {"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG os_vif [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2239eff-8aab-5b7e-a00f-9abd286bd26b', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0140779b-6c, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0140779b-6c, col_values=(('qos', UUID('f0931b82-f426-43a1-901f-4d25e61b8e55')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0140779b-6c, col_values=(('external_ids', {'iface-id': '0140779b-6c22-42a4-a580-f41c9098ab4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:80:4e', 'vm-uuid': '8d3d1884-0135-490c-bca5-1672b8d64884'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:44 user nova-compute[75235]: INFO os_vif [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c')
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No VIF found with MAC fa:16:3e:ad:80:4e, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updated VIF entry in instance network info cache for port 0140779b-6c22-42a4-a580-f41c9098ab4e. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG nova.network.neutron [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updating instance_info_cache with network_info: [{"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:13:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cea7e588-1221-411f-b5d7-0b7605b3d3ea req-bfd28814-d439-45de-b7f6-dff6e2a77b46 service nova] Releasing lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-b0147497-7473-4436-b0de-8ace93de435e req-31640eed-0aa3-400d-91b6-c59cccc69c53 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b0147497-7473-4436-b0de-8ace93de435e req-31640eed-0aa3-400d-91b6-c59cccc69c53 service nova] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b0147497-7473-4436-b0de-8ace93de435e req-31640eed-0aa3-400d-91b6-c59cccc69c53 service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b0147497-7473-4436-b0de-8ace93de435e req-31640eed-0aa3-400d-91b6-c59cccc69c53 service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-b0147497-7473-4436-b0de-8ace93de435e req-31640eed-0aa3-400d-91b6-c59cccc69c53 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] No waiting events found dispatching network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:46 user nova-compute[75235]: WARNING nova.compute.manager [req-b0147497-7473-4436-b0de-8ace93de435e req-31640eed-0aa3-400d-91b6-c59cccc69c53 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received unexpected event network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e for instance with vm_state building and task_state spawning.
Nov 29 19:13:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:13:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Instance spawned successfully.
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:13:48 user nova-compute[75235]: INFO nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:13:48 user nova-compute[75235]: INFO nova.compute.manager [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Took 6.21 seconds to build instance.
Nov 29 19:13:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3356eb5c-d4ff-4bc3-8830-07f6fa50a2c5 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.313s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-b1ecee6a-720e-4fc3-acbd-b51d2149ad8f req-c2192b74-2647-4e22-b627-8c3ed9213147 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b1ecee6a-720e-4fc3-acbd-b51d2149ad8f req-c2192b74-2647-4e22-b627-8c3ed9213147 service nova] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b1ecee6a-720e-4fc3-acbd-b51d2149ad8f req-c2192b74-2647-4e22-b627-8c3ed9213147 service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b1ecee6a-720e-4fc3-acbd-b51d2149ad8f req-c2192b74-2647-4e22-b627-8c3ed9213147 service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-b1ecee6a-720e-4fc3-acbd-b51d2149ad8f req-c2192b74-2647-4e22-b627-8c3ed9213147 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] No waiting events found dispatching network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:13:48 user nova-compute[75235]: WARNING nova.compute.manager [req-b1ecee6a-720e-4fc3-acbd-b51d2149ad8f req-c2192b74-2647-4e22-b627-8c3ed9213147 service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received unexpected event network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e for instance with vm_state active and task_state None.
Nov 29 19:13:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing instance network info cache due to event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:13:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing instance network info cache due to event network-changed-50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] Acquiring lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:13:59 user nova-compute[75235]: INFO nova.compute.manager [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Detaching volume 00f72d34-96a4-4d9b-a5be-e98c3c93649e
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:13:59 user nova-compute[75235]: INFO nova.virt.block_device [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Attempting to driver detach volume 00f72d34-96a4-4d9b-a5be-e98c3c93649e from mountpoint /dev/vdb
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updated VIF entry in instance network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a312bf96-ee14-4e7b-9961-41135c4e7348 req-59782857-edef-4d30-ab09-42b22853ec83 service nova] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] Acquired lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.network.neutron [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Refreshing network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Attempting to detach device vdb from instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:13:59 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:13:59 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:13:59 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:13:59 user nova-compute[75235]:   <serial>00f72d34-96a4-4d9b-a5be-e98c3c93649e</serial>
Nov 29 19:13:59 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 19:13:59 user nova-compute[75235]: </disk>
Nov 29 19:13:59 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully detached device vdb from instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 from the persistent domain config.
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:13:59 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:13:59 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:13:59 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:13:59 user nova-compute[75235]:   <serial>00f72d34-96a4-4d9b-a5be-e98c3c93649e</serial>
Nov 29 19:13:59 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 19:13:59 user nova-compute[75235]: </disk>
Nov 29 19:13:59 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:13:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG nova.network.neutron [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updated VIF entry in instance network info cache for port 50e951a8-6444-4285-930b-f59efb7eea7b. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG nova.network.neutron [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [{"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-01f2b295-20fd-42cc-8f0e-067608face93 req-cfd4f277-adf6-4abf-88a2-0370fa352d18 service nova] Releasing lock "refresh_cache-7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:14:01 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:14:01 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7333MB free_disk=25.083209991455078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 0547745d-4f60-430a-ad64-2607002b2c7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 20d745cf-cd85-4943-a03e-b6f9a3e0bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8d3d1884-0135-490c-bca5-1672b8d64884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:14:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:14:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid c1d8be89-d905-43dc-8d73-4632fa1e7227 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:07 user nova-compute[75235]: INFO nova.compute.manager [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Terminating instance
Nov 29 19:14:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-66f07e6c-50e0-48e1-a57c-afaf39dbcf64 req-b6221135-e20d-49bc-82d1-25929b695638 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-unplugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-66f07e6c-50e0-48e1-a57c-afaf39dbcf64 req-b6221135-e20d-49bc-82d1-25929b695638 service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-66f07e6c-50e0-48e1-a57c-afaf39dbcf64 req-b6221135-e20d-49bc-82d1-25929b695638 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-66f07e6c-50e0-48e1-a57c-afaf39dbcf64 req-b6221135-e20d-49bc-82d1-25929b695638 service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-66f07e6c-50e0-48e1-a57c-afaf39dbcf64 req-b6221135-e20d-49bc-82d1-25929b695638 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-unplugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.compute.manager [req-66f07e6c-50e0-48e1-a57c-afaf39dbcf64 req-b6221135-e20d-49bc-82d1-25929b695638 service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-unplugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:14:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Instance destroyed successfully.
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.objects.instance [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lazy-loading 'resources' on Instance uuid 20d745cf-cd85-4943-a03e-b6f9a3e0bafe {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T19:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1625356192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1625356192',id=24,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEpJcpTjeHMDxai3qqEOAIdCA0v7Hr+RNymMwe4pAA+ygLaCmvGzLhi16aFKVACV9WcFl6xJTdZkVhdfg4rGF5Fyzwqqdu4T5Xc/1zHFL3waCjPT+Dv6CmAPn5ehWpt9A==',key_name='tempest-keypair-1274433502',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:12:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f049b77ff5714114a8808a39c57e1a94',ramdisk_id='',reservation_id='r-l4j9sl90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-850280898',owner_user_name='tempest-AttachVolumeShelveTestJSON-850280898-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='556161926cf5420b82b6f33221ac8fb4',uuid=20d745cf-cd85-4943-a03e-b6f9a3e0bafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converting VIF {"id": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "address": "fa:16:3e:a4:9a:b4", "network": {"id": "12af178a-ec6a-4862-886f-edd0a420bcee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-619603015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f049b77ff5714114a8808a39c57e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8e45ee5-1a", "ovs_interfaceid": "d8e45ee5-1a5b-47aa-a478-93f107bf9788", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG os_vif [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8e45ee5-1a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30a26536-04ff-4489-8b95-11a705c71e4c) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:08 user nova-compute[75235]: INFO os_vif [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:9a:b4,bridge_name='br-int',has_traffic_filtering=True,id=d8e45ee5-1a5b-47aa-a478-93f107bf9788,network=Network(12af178a-ec6a-4862-886f-edd0a420bcee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8e45ee5-1a')
Nov 29 19:14:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Deleting instance files /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe_del
Nov 29 19:14:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Deletion of /opt/stack/data/nova/instances/20d745cf-cd85-4943-a03e-b6f9a3e0bafe_del complete
Nov 29 19:14:08 user nova-compute[75235]: INFO nova.compute.manager [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 19:14:08 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:14:08 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "0547745d-4f60-430a-ad64-2607002b2c7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:09 user nova-compute[75235]: INFO nova.compute.manager [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Terminating instance
Nov 29 19:14:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:09 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Took 0.86 seconds to deallocate network for instance.
Nov 29 19:14:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:14:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Instance destroyed successfully.
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lazy-loading 'resources' on Instance uuid 0547745d-4f60-430a-ad64-2607002b2c7d {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861594596',display_name='tempest-VolumesActionsTest-instance-1861594596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861594596',id=30,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:12:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='876373b8352b4a98be085d0f1053226e',ramdisk_id='',reservation_id='r-rhxzc3e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1431976470',owner_user_name='tempest-VolumesActionsTest-1431976470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:18Z,user_data=None,user_id='b23af78dce5c439b85a3cd330ad40437',uuid=0547745d-4f60-430a-ad64-2607002b2c7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Converting VIF {"id": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "address": "fa:16:3e:20:da:8b", "network": {"id": "be8a03a5-ab77-45a5-816a-a2620f1b0457", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1326116822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876373b8352b4a98be085d0f1053226e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1733ebcd-4c", "ovs_interfaceid": "1733ebcd-4c74-4d67-9a8c-26b667cd4a84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG os_vif [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1733ebcd-4c, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be9d3c20-82c2-4f31-bf18-4458083d6b79) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:10 user nova-compute[75235]: INFO os_vif [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:da:8b,bridge_name='br-int',has_traffic_filtering=True,id=1733ebcd-4c74-4d67-9a8c-26b667cd4a84,network=Network(be8a03a5-ab77-45a5-816a-a2620f1b0457),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1733ebcd-4c')
Nov 29 19:14:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Deleting instance files /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d_del
Nov 29 19:14:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Deletion of /opt/stack/data/nova/instances/0547745d-4f60-430a-ad64-2607002b2c7d_del complete
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Acquiring lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] No waiting events found dispatching network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:10 user nova-compute[75235]: WARNING nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received unexpected event network-vif-plugged-d8e45ee5-1a5b-47aa-a478-93f107bf9788 for instance with vm_state deleted and task_state None.
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 20d745cf-cd85-4943-a03e-b6f9a3e0bafe] Received event network-vif-deleted-d8e45ee5-1a5b-47aa-a478-93f107bf9788 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-vif-unplugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] No waiting events found dispatching network-vif-unplugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-vif-unplugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Acquiring lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] Lock "0547745d-4f60-430a-ad64-2607002b2c7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] No waiting events found dispatching network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:10 user nova-compute[75235]: WARNING nova.compute.manager [req-7357d46c-0509-42fc-94a1-ec6d6b45d038 req-21374984-82a4-4e63-85f8-cfb3fa43302b service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received unexpected event network-vif-plugged-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 for instance with vm_state active and task_state deleting.
Nov 29 19:14:10 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Deleted allocations for instance 20d745cf-cd85-4943-a03e-b6f9a3e0bafe
Nov 29 19:14:10 user nova-compute[75235]: INFO nova.compute.manager [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:14:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8808832d-c212-4297-b176-4fd0612ac148 tempest-AttachVolumeShelveTestJSON-850280898 tempest-AttachVolumeShelveTestJSON-850280898-project-member] Lock "20d745cf-cd85-4943-a03e-b6f9a3e0bafe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.576s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:11 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:11 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Took 0.72 seconds to deallocate network for instance.
Nov 29 19:14:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:14:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:14:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:11 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Deleted allocations for instance 0547745d-4f60-430a-ad64-2607002b2c7d
Nov 29 19:14:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d826040f-15c8-4677-a312-afafbfcb4efc tempest-VolumesActionsTest-1431976470 tempest-VolumesActionsTest-1431976470-project-member] Lock "0547745d-4f60-430a-ad64-2607002b2c7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-0ac02b8a-e08f-41f7-bd65-feceb1291393 req-013ff568-7819-4e1c-837b-a3e7a5edd314 service nova] [instance: 0547745d-4f60-430a-ad64-2607002b2c7d] Received event network-vif-deleted-1733ebcd-4c74-4d67-9a8c-26b667cd4a84 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:19 user nova-compute[75235]: INFO nova.compute.manager [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Rescuing
Nov 29 19:14:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-ce2e99d1-0e76-496b-8714-2ae7458f3f5d req-422e89f9-28b4-4036-88bd-cdc4b0fb705a service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ce2e99d1-0e76-496b-8714-2ae7458f3f5d req-422e89f9-28b4-4036-88bd-cdc4b0fb705a service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ce2e99d1-0e76-496b-8714-2ae7458f3f5d req-422e89f9-28b4-4036-88bd-cdc4b0fb705a service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ce2e99d1-0e76-496b-8714-2ae7458f3f5d req-422e89f9-28b4-4036-88bd-cdc4b0fb705a service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.compute.manager [req-ce2e99d1-0e76-496b-8714-2ae7458f3f5d req-422e89f9-28b4-4036-88bd-cdc4b0fb705a service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:20 user nova-compute[75235]: WARNING nova.compute.manager [req-ce2e99d1-0e76-496b-8714-2ae7458f3f5d req-422e89f9-28b4-4036-88bd-cdc4b0fb705a service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state active and task_state rescuing.
Nov 29 19:14:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 is timed out.
Nov 29 19:14:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully detached device vdb from instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 from the live domain config.
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwMsLRXW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:14:20 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cf9fd6-9452-473b-90c8-886c06fe14e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:14:20 user nova-compute[75235]: No targets found.
Nov 29 19:14:20 user nova-compute[75235]: iSNS:
Nov 29 19:14:20 user nova-compute[75235]: No targets found.
Nov 29 19:14:20 user nova-compute[75235]: STATIC:
Nov 29 19:14:20 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033
Nov 29 19:14:20 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:20 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:20 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:14:20 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:20 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:20 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e
Nov 29 19:14:20 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:20 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:20 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06
Nov 29 19:14:20 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:20 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:20 user nova-compute[75235]: FIRMWARE:
Nov 29 19:14:20 user nova-compute[75235]: No targets found.
Nov 29 19:14:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:14:20 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:14:20 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f026eed-ca8e-4a98-ae80-0055271b9c43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f12ff1f-f704-413f-bb60-1cd4c4400a91]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:20 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:14:20 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:20 user nova-compute[75235]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:14:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:20 user nova-compute[75235]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e (non-flash)
Nov 29 19:14:20 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:20 user nova-compute[75235]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:14:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c6c4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca55544-b788-4e70-be4a-6561e86bc059]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1f6e2-e14d-49e2-beb6-f36816de93c8]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3745af9-bbc8-43db-b685-30560b184f6b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[07265b79-0e73-431d-a0d7-4b7565ca222d]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e698ed-11d9-47db-919c-d9a068279ff5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b52946d-b16e-4c16-b56f-28d16c1cd878]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260]
Nov 29 19:14:20 user nova-compute[75235]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e, portal: 172.16.0.220,3260] successful.
Nov 29 19:14:20 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00f72d34-96a4-4d9b-a5be-e98c3c93649e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[26576c38-f39c-4538-a41f-4f48bf98fb33]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== disconnect_volume: return (327ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:14:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance destroyed successfully.
Nov 29 19:14:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Attempting rescue
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75235) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:14:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Creating image(s)
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue" returned: 0 in 0.048s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'migration_context' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.base [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<5380cf96-db98-487d-a6b5-bec6948e12a9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Start _get_guest_xml network_info=[{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:5d:71:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'resources' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.base [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<5380cf96-db98-487d-a6b5-bec6948e12a9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'numa_topology' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.objects.base [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<5380cf96-db98-487d-a6b5-bec6948e12a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:14:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:14:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:14:20 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.objects.base [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<5380cf96-db98-487d-a6b5-bec6948e12a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977206923',display_name='tempest-ServerRescueNegativeTestJSON-server-977206923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977206923',id=25,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-chnpghcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:09:43Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=5380cf96-db98-487d-a6b5-bec6948e12a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:5d:71:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:5d:71:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.objects.instance [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'pci_devices' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.objects.base [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<5380cf96-db98-487d-a6b5-bec6948e12a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:14:21 user nova-compute[75235]:   <uuid>5380cf96-db98-487d-a6b5-bec6948e12a9</uuid>
Nov 29 19:14:21 user nova-compute[75235]:   <name>instance-00000019</name>
Nov 29 19:14:21 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:14:21 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:14:21 user nova-compute[75235]:   <metadata>
Nov 29 19:14:21 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:14:21 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:14:21 user nova-compute[75235]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-977206923</nova:name>
Nov 29 19:14:21 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:14:20</nova:creationTime>
Nov 29 19:14:21 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:14:21 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:14:21 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:14:21 user nova-compute[75235]:       <nova:owner>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:user uuid="b09701817c0147aca7432e1329b82300">tempest-ServerRescueNegativeTestJSON-1726326315-project-member</nova:user>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:project uuid="a77e6e9f44ec4c76b5c8f8f29c7e651f">tempest-ServerRescueNegativeTestJSON-1726326315</nova:project>
Nov 29 19:14:21 user nova-compute[75235]:       </nova:owner>
Nov 29 19:14:21 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:14:21 user nova-compute[75235]:       <nova:ports>
Nov 29 19:14:21 user nova-compute[75235]:         <nova:port uuid="85fc5c4f-5bbb-4434-938a-560ee6fd2aaa">
Nov 29 19:14:21 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:14:21 user nova-compute[75235]:         </nova:port>
Nov 29 19:14:21 user nova-compute[75235]:       </nova:ports>
Nov 29 19:14:21 user nova-compute[75235]:     </nova:instance>
Nov 29 19:14:21 user nova-compute[75235]:   </metadata>
Nov 29 19:14:21 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:14:21 user nova-compute[75235]:     <system>
Nov 29 19:14:21 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:14:21 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:14:21 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:14:21 user nova-compute[75235]:       <entry name="serial">5380cf96-db98-487d-a6b5-bec6948e12a9</entry>
Nov 29 19:14:21 user nova-compute[75235]:       <entry name="uuid">5380cf96-db98-487d-a6b5-bec6948e12a9</entry>
Nov 29 19:14:21 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:14:21 user nova-compute[75235]:     </system>
Nov 29 19:14:21 user nova-compute[75235]:   </sysinfo>
Nov 29 19:14:21 user nova-compute[75235]:   <os>
Nov 29 19:14:21 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:14:21 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:14:21 user nova-compute[75235]:   </os>
Nov 29 19:14:21 user nova-compute[75235]:   <features>
Nov 29 19:14:21 user nova-compute[75235]:     <acpi/>
Nov 29 19:14:21 user nova-compute[75235]:     <apic/>
Nov 29 19:14:21 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:14:21 user nova-compute[75235]:   </features>
Nov 29 19:14:21 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:14:21 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:14:21 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:14:21 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:14:21 user nova-compute[75235]:   </clock>
Nov 29 19:14:21 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:14:21 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:14:21 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:14:21 user nova-compute[75235]:   </cpu>
Nov 29 19:14:21 user nova-compute[75235]:   <devices>
Nov 29 19:14:21 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:14:21 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:14:21 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue"/>
Nov 29 19:14:21 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:14:21 user nova-compute[75235]:     </disk>
Nov 29 19:14:21 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:14:21 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:14:21 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk"/>
Nov 29 19:14:21 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:14:21 user nova-compute[75235]:     </disk>
Nov 29 19:14:21 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:14:21 user nova-compute[75235]:       <mac address="fa:16:3e:5d:71:d0"/>
Nov 29 19:14:21 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:14:21 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:14:21 user nova-compute[75235]:       <target dev="tap85fc5c4f-5b"/>
Nov 29 19:14:21 user nova-compute[75235]:     </interface>
Nov 29 19:14:21 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:14:21 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/console.log" append="off"/>
Nov 29 19:14:21 user nova-compute[75235]:     </serial>
Nov 29 19:14:21 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:14:21 user nova-compute[75235]:     <video>
Nov 29 19:14:21 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:14:21 user nova-compute[75235]:     </video>
Nov 29 19:14:21 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:14:21 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:14:21 user nova-compute[75235]:     </rng>
Nov 29 19:14:21 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:14:21 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:14:21 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:14:21 user nova-compute[75235]:     </memballoon>
Nov 29 19:14:21 user nova-compute[75235]:   </devices>
Nov 29 19:14:21 user nova-compute[75235]: </domain>
Nov 29 19:14:21 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:14:21 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance destroyed successfully.
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:5d:71:d0, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'flavor' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c78bc9e7-d3d6-4613-a18c-60814e2b1cb9 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.927s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-3f8691a8-4083-4590-b527-43ab3440a555 req-85517af4-c5d4-4f2d-9f4b-83cb508d5552 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3f8691a8-4083-4590-b527-43ab3440a555 req-85517af4-c5d4-4f2d-9f4b-83cb508d5552 service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3f8691a8-4083-4590-b527-43ab3440a555 req-85517af4-c5d4-4f2d-9f4b-83cb508d5552 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3f8691a8-4083-4590-b527-43ab3440a555 req-85517af4-c5d4-4f2d-9f4b-83cb508d5552 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-3f8691a8-4083-4590-b527-43ab3440a555 req-85517af4-c5d4-4f2d-9f4b-83cb508d5552 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:22 user nova-compute[75235]: WARNING nova.compute.manager [req-3f8691a8-4083-4590-b527-43ab3440a555 req-85517af4-c5d4-4f2d-9f4b-83cb508d5552 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state active and task_state rescuing.
Nov 29 19:14:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:24 user nova-compute[75235]: WARNING nova.compute.manager [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state active and task_state rescuing.
Nov 29 19:14:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:24 user nova-compute[75235]: WARNING nova.compute.manager [req-c071246b-877b-4cc9-ac06-077296b4818c req-1732d2c6-edb7-4620-92c0-ccfea24ef62e service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state active and task_state rescuing.
Nov 29 19:14:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-5002c2ed-e72a-415a-baa4-b9c0ec193c90 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:14:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-changed-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Refreshing instance network info cache due to event network-changed-28cea0d8-5bab-4184-ad2f-5e9bc62110db. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] Acquiring lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] Acquired lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Refreshing network info cache for port 28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updated VIF entry in instance network info cache for port 28cea0d8-5bab-4184-ad2f-5e9bc62110db. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [{"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a7f174b2-b185-45e6-aba7-bcbe32543ce6 req-c083be01-861d-414b-adf1-ebe48369d357 service nova] Releasing lock "refresh_cache-c1d8be89-d905-43dc-8d73-4632fa1e7227" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Stashing vm_state: active {{(pid=75235) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:14:39 user nova-compute[75235]: INFO nova.compute.claims [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Claim successful on node user
Nov 29 19:14:39 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating resource usage from migration 1846064e-85fb-4934-a771-396fd5fd2859
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-changed-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Refreshing instance network info cache due to event network-changed-5c2159e5-c7e8-46d3-b968-533f0415b437. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Refreshing network info cache for port 5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.449s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:39 user nova-compute[75235]: INFO nova.compute.manager [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Migrating
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updated VIF entry in instance network info cache for port 5c2159e5-c7e8-46d3-b968-533f0415b437. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fc10536-35d6-4c13-80a3-b249e43ff741 req-c6c82847-9db2-4dc8-90ed-faf5679f5200 service nova] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:14:39 user nova-compute[75235]: DEBUG nova.network.neutron [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG nova.network.neutron [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Starting migrate_disk_and_power_off {{(pid=75235) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-24ef7a6f-a8f6-4dfe-8c47-2793f5d7875c req-4e87b345-c834-4fd1-9ea3-31d266816e25 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-unplugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-24ef7a6f-a8f6-4dfe-8c47-2793f5d7875c req-4e87b345-c834-4fd1-9ea3-31d266816e25 service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-24ef7a6f-a8f6-4dfe-8c47-2793f5d7875c req-4e87b345-c834-4fd1-9ea3-31d266816e25 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-24ef7a6f-a8f6-4dfe-8c47-2793f5d7875c req-4e87b345-c834-4fd1-9ea3-31d266816e25 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-24ef7a6f-a8f6-4dfe-8c47-2793f5d7875c req-4e87b345-c834-4fd1-9ea3-31d266816e25 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-unplugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:40 user nova-compute[75235]: WARNING nova.compute.manager [req-24ef7a6f-a8f6-4dfe-8c47-2793f5d7875c req-4e87b345-c834-4fd1-9ea3-31d266816e25 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-unplugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state active and task_state resize_migrating.
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance destroyed successfully.
Nov 29 19:14:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268210074',display_name='tempest-ServerActionsTestOtherA-server-268210074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268210074',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:13:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-7ve0syrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2159e5-c7, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f96ac3e-06af-456e-9da4-581ce501972e) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:41 user nova-compute[75235]: INFO os_vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7')
Nov 29 19:14:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:14:41 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00a099-e143-4444-9411-46740568e7bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:14:41 user nova-compute[75235]: No targets found.
Nov 29 19:14:41 user nova-compute[75235]: iSNS:
Nov 29 19:14:41 user nova-compute[75235]: No targets found.
Nov 29 19:14:41 user nova-compute[75235]: STATIC:
Nov 29 19:14:41 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033
Nov 29 19:14:41 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:41 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:41 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:14:41 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:41 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:41 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06
Nov 29 19:14:41 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:14:41 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:14:41 user nova-compute[75235]: FIRMWARE:
Nov 29 19:14:41 user nova-compute[75235]: No targets found.
Nov 29 19:14:41 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:14:41 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:14:41 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9257c8a-6f5a-41b0-9df5-6af511cd6548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6e4024-c245-4452-9c12-866c08e017a0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:41 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:41 user nova-compute[75235]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:14:41 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:41 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:41 user nova-compute[75235]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:14:41 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c70a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0c72b-851b-40ce-a428-a7f6eb2b0091]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b062f0-fa68-49ee-9d5d-3acf99248501]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc89edeb-d88e-424b-adb4-9737c437fed0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e7f1e-5118-4f7e-b439-4d50e6c099e6]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23461393539383161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_689553bb', '/dev/disk/by-id/scsi-1SCST_BIO689553bb-4a95981aa1f549fa') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bc7fba-54b2-4e15-8ca9-28c9535c33f9]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9026f9f-6856-474d-9484-fe5cdd7d2eac]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9920e46f-eef2-4395-bfaf-11a31a8f177f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]
Nov 29 19:14:41 user nova-compute[75235]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.
Nov 29 19:14:41 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b0bd69-9d93-4c89-8602-e37c75779b90]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== disconnect_volume: return (324ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:14:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG nova.network.neutron [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Port 5c2159e5-c7e8-46d3-b968-533f0415b437 binding to destination host user is already ACTIVE {{(pid=75235) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:14:42 user nova-compute[75235]: DEBUG nova.network.neutron [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-2d5e7b3c-3146-4d8e-98ac-0f1490f18fbf req-ee23368c-01ff-4e30-8805-f8e7c9dcda73 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2d5e7b3c-3146-4d8e-98ac-0f1490f18fbf req-ee23368c-01ff-4e30-8805-f8e7c9dcda73 service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2d5e7b3c-3146-4d8e-98ac-0f1490f18fbf req-ee23368c-01ff-4e30-8805-f8e7c9dcda73 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2d5e7b3c-3146-4d8e-98ac-0f1490f18fbf req-ee23368c-01ff-4e30-8805-f8e7c9dcda73 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-2d5e7b3c-3146-4d8e-98ac-0f1490f18fbf req-ee23368c-01ff-4e30-8805-f8e7c9dcda73 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:43 user nova-compute[75235]: WARNING nova.compute.manager [req-2d5e7b3c-3146-4d8e-98ac-0f1490f18fbf req-ee23368c-01ff-4e30-8805-f8e7c9dcda73 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state active and task_state resize_migrated.
Nov 29 19:14:43 user nova-compute[75235]: DEBUG nova.network.neutron [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG os_brick.utils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735bddc-6bdb-421c-be50-028a241b9b43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b7b6f-675f-4777-ae7f-fcd0034e59bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f82cf-b503-483c-881f-dfd5257d4959]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2f51d9-2b9f-4065-8a1f-2f00aa5c1906]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:14:43 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:14:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8633d4d2-4230-4496-b77a-4a79eaaf9764]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:14:43 user nova-compute[75235]: DEBUG os_brick.utils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:14:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Starting finish_migration {{(pid=75235) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:14:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Creating image(s)
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Ensure instance console log exists: /opt/stack/data/nova/instances/a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Start _get_guest_xml network_info=[{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'd3b77460-d759-4ddd-a4b6-9fca4d4344b0', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487', 'attached_at': '2023-11-29T19:14:51.000000', 'detached_at': '', 'volume_id': '2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'serial': '2f19bd84-5ddf-4b43-bc69-ea4c56d21d06'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:14:51 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:14:51 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:14:51 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:14:51 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:14:51 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2789541-c2a9-4839-816c-a3fec122375a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:14:51 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d44108-3d7c-41bd-a257-d47849933933]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06] added
Nov 29 19:14:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb86dc-d494-47bc-939f-9dcb21c3f5b6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f311421a-db83-4fc8-adbb-93a41d302f55]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGPzjvd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUGPzjvd" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0403444-2b80-4674-bfba-cb5a59c5598a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUGPzjvd'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54cf2d6-2173-42e6-890c-ff1677bc592a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ccbfd-4bb2-45a7-873d-bc10f3bb02c6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c23b4-dcf3-48bf-90aa-7c0abbfe25a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]
Nov 29 19:14:51 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.
Nov 29 19:14:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e32cb5-7678-4dc4-a1ea-47a8698ec9ff]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1eec8-3499-4155-b964-3f7ab151de5b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:14:51 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[84554978-9fde-4414-94ef-8507a2a3155a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:14:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23461393539383161', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461393539383161', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268210074',display_name='tempest-ServerActionsTestOtherA-server-268210074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268210074',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:13:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-7ve0syrm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:14:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:14:52 user nova-compute[75235]:   <uuid>a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487</uuid>
Nov 29 19:14:52 user nova-compute[75235]:   <name>instance-0000001f</name>
Nov 29 19:14:52 user nova-compute[75235]:   <memory>2097152</memory>
Nov 29 19:14:52 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:14:52 user nova-compute[75235]:   <metadata>
Nov 29 19:14:52 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:14:52 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:14:52 user nova-compute[75235]:       <nova:name>tempest-ServerActionsTestOtherA-server-268210074</nova:name>
Nov 29 19:14:52 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:14:51</nova:creationTime>
Nov 29 19:14:52 user nova-compute[75235]:       <nova:flavor name="m1.small">
Nov 29 19:14:52 user nova-compute[75235]:         <nova:memory>2048</nova:memory>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:disk>20</nova:disk>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:14:52 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:14:52 user nova-compute[75235]:       <nova:owner>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:user uuid="1d98bb13233f447295cf54cb5b1574e8">tempest-ServerActionsTestOtherA-279549641-project-member</nova:user>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:project uuid="68dafa45545c46169abd1cad11ba15cc">tempest-ServerActionsTestOtherA-279549641</nova:project>
Nov 29 19:14:52 user nova-compute[75235]:       </nova:owner>
Nov 29 19:14:52 user nova-compute[75235]:       <nova:ports>
Nov 29 19:14:52 user nova-compute[75235]:         <nova:port uuid="5c2159e5-c7e8-46d3-b968-533f0415b437">
Nov 29 19:14:52 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:14:52 user nova-compute[75235]:         </nova:port>
Nov 29 19:14:52 user nova-compute[75235]:       </nova:ports>
Nov 29 19:14:52 user nova-compute[75235]:     </nova:instance>
Nov 29 19:14:52 user nova-compute[75235]:   </metadata>
Nov 29 19:14:52 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:14:52 user nova-compute[75235]:     <system>
Nov 29 19:14:52 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:14:52 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:14:52 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:14:52 user nova-compute[75235]:       <entry name="serial">a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487</entry>
Nov 29 19:14:52 user nova-compute[75235]:       <entry name="uuid">a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487</entry>
Nov 29 19:14:52 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:14:52 user nova-compute[75235]:     </system>
Nov 29 19:14:52 user nova-compute[75235]:   </sysinfo>
Nov 29 19:14:52 user nova-compute[75235]:   <os>
Nov 29 19:14:52 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:14:52 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:14:52 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:14:52 user nova-compute[75235]:   </os>
Nov 29 19:14:52 user nova-compute[75235]:   <features>
Nov 29 19:14:52 user nova-compute[75235]:     <acpi/>
Nov 29 19:14:52 user nova-compute[75235]:     <apic/>
Nov 29 19:14:52 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:14:52 user nova-compute[75235]:   </features>
Nov 29 19:14:52 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:14:52 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:14:52 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:14:52 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:14:52 user nova-compute[75235]:   </clock>
Nov 29 19:14:52 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:14:52 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:14:52 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:14:52 user nova-compute[75235]:   </cpu>
Nov 29 19:14:52 user nova-compute[75235]:   <devices>
Nov 29 19:14:52 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:14:52 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:14:52 user nova-compute[75235]:       <source dev="/dev/sdc"/>
Nov 29 19:14:52 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:14:52 user nova-compute[75235]:       <serial>2f19bd84-5ddf-4b43-bc69-ea4c56d21d06</serial>
Nov 29 19:14:52 user nova-compute[75235]:     </disk>
Nov 29 19:14:52 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:14:52 user nova-compute[75235]:       <mac address="fa:16:3e:93:cd:6a"/>
Nov 29 19:14:52 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:14:52 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:14:52 user nova-compute[75235]:       <target dev="tap5c2159e5-c7"/>
Nov 29 19:14:52 user nova-compute[75235]:     </interface>
Nov 29 19:14:52 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:14:52 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487/console.log" append="off"/>
Nov 29 19:14:52 user nova-compute[75235]:     </serial>
Nov 29 19:14:52 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:14:52 user nova-compute[75235]:     <video>
Nov 29 19:14:52 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:14:52 user nova-compute[75235]:     </video>
Nov 29 19:14:52 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:14:52 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:14:52 user nova-compute[75235]:     </rng>
Nov 29 19:14:52 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:14:52 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:14:52 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:14:52 user nova-compute[75235]:     </memballoon>
Nov 29 19:14:52 user nova-compute[75235]:   </devices>
Nov 29 19:14:52 user nova-compute[75235]: </domain>
Nov 29 19:14:52 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268210074',display_name='tempest-ServerActionsTestOtherA-server-268210074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268210074',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:13:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-7ve0syrm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:14:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1062089477-network", "vif_mac": "fa:16:3e:93:cd:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG os_vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38622916-814a-5dd8-92b6-4ed200b7ad24', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c2159e5-c7, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c2159e5-c7, col_values=(('qos', UUID('5404e66f-5ee7-466b-9663-3789a8149d9d')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c2159e5-c7, col_values=(('external_ids', {'iface-id': '5c2159e5-c7e8-46d3-b968-533f0415b437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:cd:6a', 'vm-uuid': 'a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:52 user nova-compute[75235]: INFO os_vif [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7')
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:14:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] No VIF found with MAC fa:16:3e:93:cd:6a, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:14:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-1eec3c23-b168-4bdd-a0c4-51ccf8ae3579 req-64301ef1-28c1-4b67-9cce-dd2c3ef3eb3b service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1eec3c23-b168-4bdd-a0c4-51ccf8ae3579 req-64301ef1-28c1-4b67-9cce-dd2c3ef3eb3b service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1eec3c23-b168-4bdd-a0c4-51ccf8ae3579 req-64301ef1-28c1-4b67-9cce-dd2c3ef3eb3b service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1eec3c23-b168-4bdd-a0c4-51ccf8ae3579 req-64301ef1-28c1-4b67-9cce-dd2c3ef3eb3b service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-1eec3c23-b168-4bdd-a0c4-51ccf8ae3579 req-64301ef1-28c1-4b67-9cce-dd2c3ef3eb3b service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:54 user nova-compute[75235]: WARNING nova.compute.manager [req-1eec3c23-b168-4bdd-a0c4-51ccf8ae3579 req-64301ef1-28c1-4b67-9cce-dd2c3ef3eb3b service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state active and task_state resize_finish.
Nov 29 19:14:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:54 user nova-compute[75235]: INFO nova.compute.manager [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Terminating instance
Nov 29 19:14:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-5f33d806-cb10-4023-b459-5cb2144ea86b req-a8db733c-8491-4ce7-b2a0-eb16e29fc379 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-unplugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5f33d806-cb10-4023-b459-5cb2144ea86b req-a8db733c-8491-4ce7-b2a0-eb16e29fc379 service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5f33d806-cb10-4023-b459-5cb2144ea86b req-a8db733c-8491-4ce7-b2a0-eb16e29fc379 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5f33d806-cb10-4023-b459-5cb2144ea86b req-a8db733c-8491-4ce7-b2a0-eb16e29fc379 service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-5f33d806-cb10-4023-b459-5cb2144ea86b req-a8db733c-8491-4ce7-b2a0-eb16e29fc379 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-unplugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-5f33d806-cb10-4023-b459-5cb2144ea86b req-a8db733c-8491-4ce7-b2a0-eb16e29fc379 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-unplugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Instance destroyed successfully.
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.objects.instance [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'resources' on Instance uuid 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-944730773',display_name='tempest-TestMinimumBasicScenario-server-944730773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-944730773',id=27,image_ref='28cd689c-cf20-4711-8908-bc2161826e48',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrLc5L/3ikTAmF40N0kwuBkwON2gpV6ZhKtBUiyc1D29JdVe4NFAZZz01pKjdeff/HIAnbJUe2AocBXM0xF1uVOEx/RV45kJstVwP7EktflDZYhnyTAFGV5Jxpb837+Yw==',key_name='tempest-TestMinimumBasicScenario-1275015280',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0s7jj5m3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28cd689c-cf20-4711-8908-bc2161826e48',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:14Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=7c38c492-a28b-4f1f-96f4-5e2dde6d9de2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "50e951a8-6444-4285-930b-f59efb7eea7b", "address": "fa:16:3e:28:20:de", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e951a8-64", "ovs_interfaceid": "50e951a8-6444-4285-930b-f59efb7eea7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG os_vif [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50e951a8-64, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1a15a6c-f8f1-4e63-b550-f1b36353a3a6) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:14:55 user nova-compute[75235]: INFO os_vif [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:20:de,bridge_name='br-int',has_traffic_filtering=True,id=50e951a8-6444-4285-930b-f59efb7eea7b,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e951a8-64')
Nov 29 19:14:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Deleting instance files /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2_del
Nov 29 19:14:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Deletion of /opt/stack/data/nova/instances/7c38c492-a28b-4f1f-96f4-5e2dde6d9de2_del complete
Nov 29 19:14:55 user nova-compute[75235]: INFO nova.compute.manager [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 19:14:55 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1de0d1d3-17ad-4ce8-b267-4e50dcfec69c req-f2130049-ec06-4c4a-bc9f-e26f94342031 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-deleted-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:55 user nova-compute[75235]: INFO nova.compute.manager [req-1de0d1d3-17ad-4ce8-b267-4e50dcfec69c req-f2130049-ec06-4c4a-bc9f-e26f94342031 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Neutron deleted interface 50e951a8-6444-4285-930b-f59efb7eea7b; detaching it from the instance and deleting it from the info cache
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.network.neutron [req-1de0d1d3-17ad-4ce8-b267-4e50dcfec69c req-f2130049-ec06-4c4a-bc9f-e26f94342031 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:14:55 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Took 0.58 seconds to deallocate network for instance.
Nov 29 19:14:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1de0d1d3-17ad-4ce8-b267-4e50dcfec69c req-f2130049-ec06-4c4a-bc9f-e26f94342031 service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Detach interface failed, port_id=50e951a8-6444-4285-930b-f59efb7eea7b, reason: Instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:14:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance running successfully.
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Failed to set time: agent not configured {{(pid=75235) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-180cd394-4c79-466a-a18a-f142d161960b tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] finish_migration finished successfully. {{(pid=75235) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-9def7eb5-17e4-477d-a2db-9684b544f0cd req-ed1d6d28-ffcb-47b8-9194-46ebd2cf2d5c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9def7eb5-17e4-477d-a2db-9684b544f0cd req-ed1d6d28-ffcb-47b8-9194-46ebd2cf2d5c service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9def7eb5-17e4-477d-a2db-9684b544f0cd req-ed1d6d28-ffcb-47b8-9194-46ebd2cf2d5c service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9def7eb5-17e4-477d-a2db-9684b544f0cd req-ed1d6d28-ffcb-47b8-9194-46ebd2cf2d5c service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-9def7eb5-17e4-477d-a2db-9684b544f0cd req-ed1d6d28-ffcb-47b8-9194-46ebd2cf2d5c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:56 user nova-compute[75235]: WARNING nova.compute.manager [req-9def7eb5-17e4-477d-a2db-9684b544f0cd req-ed1d6d28-ffcb-47b8-9194-46ebd2cf2d5c service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state active and task_state resize_finish.
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:56 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Deleted allocations for instance 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-066a91dc-936e-4f6f-b343-d12fea9869fd tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-c9794e46-81d2-4a77-8527-06323ffa1659 req-2ee8009a-6451-4d22-8220-3a946128e78f service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c9794e46-81d2-4a77-8527-06323ffa1659 req-2ee8009a-6451-4d22-8220-3a946128e78f service nova] Acquiring lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c9794e46-81d2-4a77-8527-06323ffa1659 req-2ee8009a-6451-4d22-8220-3a946128e78f service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c9794e46-81d2-4a77-8527-06323ffa1659 req-2ee8009a-6451-4d22-8220-3a946128e78f service nova] Lock "7c38c492-a28b-4f1f-96f4-5e2dde6d9de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-c9794e46-81d2-4a77-8527-06323ffa1659 req-2ee8009a-6451-4d22-8220-3a946128e78f service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] No waiting events found dispatching network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:14:56 user nova-compute[75235]: WARNING nova.compute.manager [req-c9794e46-81d2-4a77-8527-06323ffa1659 req-2ee8009a-6451-4d22-8220-3a946128e78f service nova] [instance: 7c38c492-a28b-4f1f-96f4-5e2dde6d9de2] Received unexpected event network-vif-plugged-50e951a8-6444-4285-930b-f59efb7eea7b for instance with vm_state deleted and task_state None.
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:14:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:00 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:15:00 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=25.12494659423828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Applying migration context for instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 as it has an incoming, in-progress migration 1846064e-85fb-4934-a771-396fd5fd2859. Migration status is finished {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 19:15:00 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating resource usage from migration 1846064e-85fb-4934-a771-396fd5fd2859
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8d3d1884-0135-490c-bca5-1672b8d64884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Migration 1846064e-85fb-4934-a771-396fd5fd2859 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:15:00 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:15:01 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:15:01 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:15:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:15:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.787s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updating instance_info_cache with network_info: [{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:04 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:15:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:15:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:15:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:23 user nova-compute[75235]: INFO nova.compute.manager [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Terminating instance
Nov 29 19:15:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:15:23 user nova-compute[75235]: INFO nova.compute.claims [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Claim successful on node user
Nov 29 19:15:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-d57eae94-e3df-4d09-a538-8d075b312afa req-0b17a70f-e1c8-4340-8efc-524eaa6f2e16 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d57eae94-e3df-4d09-a538-8d075b312afa req-0b17a70f-e1c8-4340-8efc-524eaa6f2e16 service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d57eae94-e3df-4d09-a538-8d075b312afa req-0b17a70f-e1c8-4340-8efc-524eaa6f2e16 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d57eae94-e3df-4d09-a538-8d075b312afa req-0b17a70f-e1c8-4340-8efc-524eaa6f2e16 service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-d57eae94-e3df-4d09-a538-8d075b312afa req-0b17a70f-e1c8-4340-8efc-524eaa6f2e16 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-d57eae94-e3df-4d09-a538-8d075b312afa req-0b17a70f-e1c8-4340-8efc-524eaa6f2e16 service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Instance destroyed successfully.
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lazy-loading 'resources' on Instance uuid 667a5ca0-f308-4eb9-a025-14c49ff25eb3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2026348765',display_name='tempest-ServerActionsTestOtherB-server-2026348765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2026348765',id=20,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqsgts4ZOSpXNVVuI3omnDFyIXXIM0rFZfiw6M2g5YlSNKDEK/uZ+Dw8S5T9NUB2EvPD8oSqiYMOjfFA2qm1kyAItkiJUXJVXopVm9dVvB7+7r6orSIYzAr36Vlmxba+Q==',key_name='tempest-keypair-1946929131',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:12:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ccc9827eb540868fea8b5891c75338',ramdisk_id='',reservation_id='r-8zhv46iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1405811153',owner_user_name='tempest-ServerActionsTestOtherB-1405811153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1fe2271d5ad4b97acdbfcd699e3829a',uuid=667a5ca0-f308-4eb9-a025-14c49ff25eb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converting VIF {"id": "644e59e3-44e4-43e5-8d47-a226b1457182", "address": "fa:16:3e:b2:6a:b3", "network": {"id": "67685280-fc04-42eb-bdd3-7332bcd1f931", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2075469504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52ccc9827eb540868fea8b5891c75338", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap644e59e3-44", "ovs_interfaceid": "644e59e3-44e4-43e5-8d47-a226b1457182", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_vif [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap644e59e3-44, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fdd05f6-4a60-42a2-9e53-ba976d2ea454) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: INFO os_vif [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6a:b3,bridge_name='br-int',has_traffic_filtering=True,id=644e59e3-44e4-43e5-8d47-a226b1457182,network=Network(67685280-fc04-42eb-bdd3-7332bcd1f931),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap644e59e3-44')
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RiLWeznm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:15:24 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af5bd2-71c3-4daf-bb6b-37276f15cceb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:15:24 user nova-compute[75235]: No targets found.
Nov 29 19:15:24 user nova-compute[75235]: iSNS:
Nov 29 19:15:24 user nova-compute[75235]: No targets found.
Nov 29 19:15:24 user nova-compute[75235]: STATIC:
Nov 29 19:15:24 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033
Nov 29 19:15:24 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:15:24 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:15:24 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:15:24 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:15:24 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:15:24 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06
Nov 29 19:15:24 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:15:24 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:15:24 user nova-compute[75235]: FIRMWARE:
Nov 29 19:15:24 user nova-compute[75235]: No targets found.
Nov 29 19:15:24 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:15:24 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:15:24 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc06fdf-d5cc-4d90-b5f5-b19f44b133de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce57bb-e53f-4564-9512-68181d263449]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:24 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:15:24 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:24 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:24 user nova-compute[75235]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 (non-flash)
Nov 29 19:15:24 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:24 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c77b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6b3ff-6985-4276-80e6-4427313baa54]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370d9c2-a470-4e6c-b89a-eae2ab2e362c]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c403b20-ef9f-4ad7-b250-982f93a96cba]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:15:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c73ec-138e-4f7d-af76-a8719d187701]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6376bc8-a4eb-4449-b954-22a81085d24e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.policy [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c547f019112442b7ac97442ce3432365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b84f68d6c554611a982ef7326409952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ca237-a817-4ad6-944e-e49b23868a7c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260]
Nov 29 19:15:24 user nova-compute[75235]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033, portal: 172.16.0.220,3260] successful.
Nov 29 19:15:24 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4801896-ec3b-4de0-b0e7-132535a07033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa0a31-71e2-4859-988e-55412a4a75dc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] <== disconnect_volume: return (386ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:15:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Deleting instance files /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3_del
Nov 29 19:15:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Deletion of /opt/stack/data/nova/instances/667a5ca0-f308-4eb9-a025-14c49ff25eb3_del complete
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:15:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Creating image(s)
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "/opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: INFO nova.compute.manager [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.231s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.249s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Successfully created port: 35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk 1073741824" returned: 0 in 0.139s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.228s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Cannot resize image /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Ensure instance console log exists: /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Successfully updated port: 35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:15:25 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Took 1.12 seconds to deallocate network for instance.
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-changed-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Refreshing instance network info cache due to event network-changed-35a1b666-5951-4075-81f5-96cae92d02d3. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] Acquiring lock "refresh_cache-04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:25 user nova-compute[75235]: WARNING nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state deleting.
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:25 user nova-compute[75235]: WARNING nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state deleting.
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:25 user nova-compute[75235]: WARNING nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state deleting.
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-unplugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Acquiring lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] No waiting events found dispatching network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:25 user nova-compute[75235]: WARNING nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received unexpected event network-vif-plugged-644e59e3-44e4-43e5-8d47-a226b1457182 for instance with vm_state active and task_state deleting.
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-172dbb67-7c03-4803-b390-7b97c5488d9e req-9cce0ebc-e3a6-4780-95ea-8508d697e6ca service nova] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Received event network-vif-deleted-644e59e3-44e4-43e5-8d47-a226b1457182 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Updating instance_info_cache with network_info: [{"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Instance network_info: |[{"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] Acquired lock "refresh_cache-04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Refreshing network info cache for port 35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Start _get_guest_xml network_info=[{"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:15:26 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:15:26 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-974024086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-974024086',id=33,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-sjr64mr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:15:24Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.objects.instance [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'pci_devices' on Instance uuid 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:15:26 user nova-compute[75235]:   <uuid>04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a</uuid>
Nov 29 19:15:26 user nova-compute[75235]:   <name>instance-00000021</name>
Nov 29 19:15:26 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:15:26 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:15:26 user nova-compute[75235]:   <metadata>
Nov 29 19:15:26 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:15:26 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:15:26 user nova-compute[75235]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-974024086</nova:name>
Nov 29 19:15:26 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:15:26</nova:creationTime>
Nov 29 19:15:26 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:15:26 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:15:26 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:15:26 user nova-compute[75235]:       <nova:owner>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:user uuid="c547f019112442b7ac97442ce3432365">tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member</nova:user>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:project uuid="9b84f68d6c554611a982ef7326409952">tempest-ServerBootFromVolumeStableRescueTest-1553615524</nova:project>
Nov 29 19:15:26 user nova-compute[75235]:       </nova:owner>
Nov 29 19:15:26 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:15:26 user nova-compute[75235]:       <nova:ports>
Nov 29 19:15:26 user nova-compute[75235]:         <nova:port uuid="35a1b666-5951-4075-81f5-96cae92d02d3">
Nov 29 19:15:26 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:15:26 user nova-compute[75235]:         </nova:port>
Nov 29 19:15:26 user nova-compute[75235]:       </nova:ports>
Nov 29 19:15:26 user nova-compute[75235]:     </nova:instance>
Nov 29 19:15:26 user nova-compute[75235]:   </metadata>
Nov 29 19:15:26 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:15:26 user nova-compute[75235]:     <system>
Nov 29 19:15:26 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:15:26 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:15:26 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:15:26 user nova-compute[75235]:       <entry name="serial">04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a</entry>
Nov 29 19:15:26 user nova-compute[75235]:       <entry name="uuid">04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a</entry>
Nov 29 19:15:26 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:15:26 user nova-compute[75235]:     </system>
Nov 29 19:15:26 user nova-compute[75235]:   </sysinfo>
Nov 29 19:15:26 user nova-compute[75235]:   <os>
Nov 29 19:15:26 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:15:26 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:15:26 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:15:26 user nova-compute[75235]:   </os>
Nov 29 19:15:26 user nova-compute[75235]:   <features>
Nov 29 19:15:26 user nova-compute[75235]:     <acpi/>
Nov 29 19:15:26 user nova-compute[75235]:     <apic/>
Nov 29 19:15:26 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:15:26 user nova-compute[75235]:   </features>
Nov 29 19:15:26 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:15:26 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:15:26 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:15:26 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:15:26 user nova-compute[75235]:   </clock>
Nov 29 19:15:26 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:15:26 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:15:26 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:15:26 user nova-compute[75235]:   </cpu>
Nov 29 19:15:26 user nova-compute[75235]:   <devices>
Nov 29 19:15:26 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:15:26 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:15:26 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk"/>
Nov 29 19:15:26 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:15:26 user nova-compute[75235]:     </disk>
Nov 29 19:15:26 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:15:26 user nova-compute[75235]:       <mac address="fa:16:3e:59:61:51"/>
Nov 29 19:15:26 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:15:26 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:15:26 user nova-compute[75235]:       <target dev="tap35a1b666-59"/>
Nov 29 19:15:26 user nova-compute[75235]:     </interface>
Nov 29 19:15:26 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:15:26 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/console.log" append="off"/>
Nov 29 19:15:26 user nova-compute[75235]:     </serial>
Nov 29 19:15:26 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:15:26 user nova-compute[75235]:     <video>
Nov 29 19:15:26 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:15:26 user nova-compute[75235]:     </video>
Nov 29 19:15:26 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:15:26 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:15:26 user nova-compute[75235]:     </rng>
Nov 29 19:15:26 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:15:26 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:15:26 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:15:26 user nova-compute[75235]:     </memballoon>
Nov 29 19:15:26 user nova-compute[75235]:   </devices>
Nov 29 19:15:26 user nova-compute[75235]: </domain>
Nov 29 19:15:26 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-974024086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-974024086',id=33,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-sjr64mr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:15:24Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG os_vif [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d03f91d-5a4e-5814-9e07-451033f7cb3e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35a1b666-59, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35a1b666-59, col_values=(('qos', UUID('53e89f54-6a59-4451-b870-12e58cfa2b49')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35a1b666-59, col_values=(('external_ids', {'iface-id': '35a1b666-5951-4075-81f5-96cae92d02d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:61:51', 'vm-uuid': '04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:26 user nova-compute[75235]: INFO os_vif [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59')
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No VIF found with MAC fa:16:3e:59:61:51, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Updated VIF entry in instance network info cache for port 35a1b666-5951-4075-81f5-96cae92d02d3. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Updating instance_info_cache with network_info: [{"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-803dbbda-b457-4695-82fa-15f63d12710d req-d1e8c719-3656-4b97-a165-006e4997ea36 service nova] Releasing lock "refresh_cache-04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:15:26 user nova-compute[75235]: INFO nova.compute.manager [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] [instance: 667a5ca0-f308-4eb9-a025-14c49ff25eb3] Took 1.10 seconds to detach 1 volumes for instance.
Nov 29 19:15:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:27 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Deleted allocations for instance 667a5ca0-f308-4eb9-a025-14c49ff25eb3
Nov 29 19:15:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-13f5dfe6-e940-49b8-9e14-03913b692c18 tempest-ServerActionsTestOtherB-1405811153 tempest-ServerActionsTestOtherB-1405811153-project-member] Lock "667a5ca0-f308-4eb9-a025-14c49ff25eb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.187s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3f01b80-79ec-4daf-9249-6cf122df8969 req-6264db66-3d26-4ffa-a725-1fa949ab8bc3 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3f01b80-79ec-4daf-9249-6cf122df8969 req-6264db66-3d26-4ffa-a725-1fa949ab8bc3 service nova] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3f01b80-79ec-4daf-9249-6cf122df8969 req-6264db66-3d26-4ffa-a725-1fa949ab8bc3 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3f01b80-79ec-4daf-9249-6cf122df8969 req-6264db66-3d26-4ffa-a725-1fa949ab8bc3 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3f01b80-79ec-4daf-9249-6cf122df8969 req-6264db66-3d26-4ffa-a725-1fa949ab8bc3 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] No waiting events found dispatching network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:27 user nova-compute[75235]: WARNING nova.compute.manager [req-f3f01b80-79ec-4daf-9249-6cf122df8969 req-6264db66-3d26-4ffa-a725-1fa949ab8bc3 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received unexpected event network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 for instance with vm_state building and task_state spawning.
Nov 29 19:15:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-cb6d25c2-d1d9-4a45-bd79-34e11c241dd0 req-bc15ff4a-8510-43a2-a679-d9f28bd2e661 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cb6d25c2-d1d9-4a45-bd79-34e11c241dd0 req-bc15ff4a-8510-43a2-a679-d9f28bd2e661 service nova] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cb6d25c2-d1d9-4a45-bd79-34e11c241dd0 req-bc15ff4a-8510-43a2-a679-d9f28bd2e661 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cb6d25c2-d1d9-4a45-bd79-34e11c241dd0 req-bc15ff4a-8510-43a2-a679-d9f28bd2e661 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-cb6d25c2-d1d9-4a45-bd79-34e11c241dd0 req-bc15ff4a-8510-43a2-a679-d9f28bd2e661 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] No waiting events found dispatching network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:30 user nova-compute[75235]: WARNING nova.compute.manager [req-cb6d25c2-d1d9-4a45-bd79-34e11c241dd0 req-bc15ff4a-8510-43a2-a679-d9f28bd2e661 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received unexpected event network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 for instance with vm_state building and task_state spawning.
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:15:30 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Instance spawned successfully.
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:30 user nova-compute[75235]: INFO nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 29 19:15:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:15:30 user nova-compute[75235]: INFO nova.compute.manager [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Took 6.92 seconds to build instance.
Nov 29 19:15:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8e43820d-d457-4fc6-8142-05aa79a2d581 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.060s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-changed-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Refreshing instance network info cache due to event network-changed-0140779b-6c22-42a4-a580-f41c9098ab4e. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] Acquiring lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] Acquired lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Refreshing network info cache for port 0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updated VIF entry in instance network info cache for port 0140779b-6c22-42a4-a580-f41c9098ab4e. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG nova.network.neutron [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updating instance_info_cache with network_info: [{"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-814cc141-7fbb-4224-9162-35c2e67bad4a req-ab673e0e-b694-4669-9a83-8fdbfbe05f9b service nova] Releasing lock "refresh_cache-8d3d1884-0135-490c-bca5-1672b8d64884" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG nova.objects.instance [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'flavor' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:34 user nova-compute[75235]: INFO nova.compute.manager [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attaching volume 38861818-0b73-4a09-8985-486228cabe55 to /dev/vdb
Nov 29 19:15:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG os_brick.utils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4742cd31-884c-4ceb-b0eb-0ad37584241f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb40103-6f3a-4b08-8c8c-fda02223e295]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5a649-a4e4-47bb-926e-0393a6ae5212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[80095577-3f62-4290-af17-07e2968596ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:15:34 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:15:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9d4aa-543d-4fb6-b339-b6098118450a]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG os_brick.utils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:15:34 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updating existing volume attachment record: a461a9f2-f5dc-424d-8637-98118020c544 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:15:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqHEUbsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:15:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:15:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:15:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:15:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:15:42 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:15:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6880e8-c184-494a-8e14-b98e3090f7d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:15:42 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af33dc-cad2-4de8-8510-384eb75fa245]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55] added
Nov 29 19:15:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4463a48-d664-441a-8fef-51cbfe8e464a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd2bf26-ce40-4c2a-ab17-a4e90a8ad86e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqHEUbsm {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqHEUbsm" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bce2c32-4000-4633-b60e-eaf54b198675]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqHEUbsm'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f697a004-03d1-44b3-b875-8e840669d5e3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe0e0b-cf88-429c-bb8c-e7cba716c3c1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f349fa45-07b4-4716-8a0a-ee1a2bc7117c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260]
Nov 29 19:15:43 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260] successful.
Nov 29 19:15:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3650e-8978-447d-a1bf-d50fe6f3238b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f045ec5-d1bc-41b3-ba3e-b5069eb3d2af]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:15:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2076119-1233-43b7-a019-f718c3ea174c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:15:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqHEUbsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23033636638343434', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033636638343434', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'flavor' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:15:44 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:15:44 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:15:44 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:15:44 user nova-compute[75235]:   <serial>38861818-0b73-4a09-8985-486228cabe55</serial>
Nov 29 19:15:44 user nova-compute[75235]: </disk>
Nov 29 19:15:44 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No VIF found with MAC fa:16:3e:ad:80:4e, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:15:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d58d1e3-dd7e-46e0-a0fa-97818205039b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.548s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'flavor' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:49 user nova-compute[75235]: INFO nova.compute.manager [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attaching volume ca855044-4065-4bc9-a20e-64253557c292 to /dev/vdc
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:15:49 user nova-compute[75235]: INFO nova.compute.claims [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Claim successful on node user
Nov 29 19:15:49 user nova-compute[75235]: DEBUG os_brick.utils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97f887-c276-40bc-a2af-c3e42f80ed52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[699b0882-86ea-44b8-a957-e325192e635b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2dafbf-7614-4365-93ac-8bf29b7ef749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[447eb08a-1e7a-4fb6-8ab7-83859f9b7966]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:15:49 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb961af-fbc8-4949-9970-f6c815f66f30]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG os_brick.utils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updating existing volume attachment record: a0234f0c-1b9f-43d1-9eb1-2435d67e02c0 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:15:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:15:49 user nova-compute[75235]: DEBUG nova.policy [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b20e89d8a3f4c29a3e97aceccff1ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8731c8d62643ada4847f70bdb57d4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:15:50 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Creating image(s)
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "/opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "/opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "/opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "449af33248b935cbeedfc38b77d43789e69f09d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "449af33248b935cbeedfc38b77d43789e69f09d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG nova.network.neutron [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Successfully created port: 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG nova.virt.images [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] f6fe8492-a62d-4248-ace4-7c82a6e037c8 was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:15:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.part /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.part /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.converted" returned: 0 in 0.352s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "449af33248b935cbeedfc38b77d43789e69f09d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.227s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "449af33248b935cbeedfc38b77d43789e69f09d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "449af33248b935cbeedfc38b77d43789e69f09d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Successfully updated port: 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing instance network info cache due to event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9,backing_fmt=raw /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG nova.network.neutron [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9,backing_fmt=raw /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk 1073741824" returned: 0 in 0.050s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "449af33248b935cbeedfc38b77d43789e69f09d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.neutron [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance network_info: |[{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Cannot resize image /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Ensure instance console log exists: /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Start _get_guest_xml network_info=[{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T19:15:46Z,direct_url=<?>,disk_format='qcow2',id=f6fe8492-a62d-4248-ace4-7c82a6e037c8,min_disk=0,min_ram=0,name='tempest-scenario-img--818655699',owner='af8731c8d62643ada4847f70bdb57d4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T19:15:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'f6fe8492-a62d-4248-ace4-7c82a6e037c8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:15:52 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:15:52 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T19:15:46Z,direct_url=<?>,disk_format='qcow2',id=f6fe8492-a62d-4248-ace4-7c82a6e037c8,min_disk=0,min_ram=0,name='tempest-scenario-img--818655699',owner='af8731c8d62643ada4847f70bdb57d4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T19:15:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557921067',display_name='tempest-TestMinimumBasicScenario-server-557921067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-557921067',id=34,image_ref='f6fe8492-a62d-4248-ace4-7c82a6e037c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfcdEytz1BIzpr4je2pqaAYwIUGawBipy6BMPyUsJ65Iow2QkVmTiOiMvhdfOc22t1CjDne4kQoDJtgiUcLGcanLkCfMprIdUMnqCkVIiPSEMm1lMAsvTgNSDQ0s65eg==',key_name='tempest-TestMinimumBasicScenario-1043254627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0hdo86rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f6fe8492-a62d-4248-ace4-7c82a6e037c8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:15:50Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=2270adba-8fe5-4334-83c3-0adf678b22fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.objects.instance [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'pci_devices' on Instance uuid 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:15:52 user nova-compute[75235]:   <uuid>2270adba-8fe5-4334-83c3-0adf678b22fd</uuid>
Nov 29 19:15:52 user nova-compute[75235]:   <name>instance-00000022</name>
Nov 29 19:15:52 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:15:52 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:15:52 user nova-compute[75235]:   <metadata>
Nov 29 19:15:52 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:15:52 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:15:52 user nova-compute[75235]:       <nova:name>tempest-TestMinimumBasicScenario-server-557921067</nova:name>
Nov 29 19:15:52 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:15:52</nova:creationTime>
Nov 29 19:15:52 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:15:52 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:15:52 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:15:52 user nova-compute[75235]:       <nova:owner>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:user uuid="3b20e89d8a3f4c29a3e97aceccff1ac6">tempest-TestMinimumBasicScenario-937004198-project-member</nova:user>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:project uuid="af8731c8d62643ada4847f70bdb57d4e">tempest-TestMinimumBasicScenario-937004198</nova:project>
Nov 29 19:15:52 user nova-compute[75235]:       </nova:owner>
Nov 29 19:15:52 user nova-compute[75235]:       <nova:root type="image" uuid="f6fe8492-a62d-4248-ace4-7c82a6e037c8"/>
Nov 29 19:15:52 user nova-compute[75235]:       <nova:ports>
Nov 29 19:15:52 user nova-compute[75235]:         <nova:port uuid="6b034b10-f86b-4912-a6df-b9c5334a816c">
Nov 29 19:15:52 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:15:52 user nova-compute[75235]:         </nova:port>
Nov 29 19:15:52 user nova-compute[75235]:       </nova:ports>
Nov 29 19:15:52 user nova-compute[75235]:     </nova:instance>
Nov 29 19:15:52 user nova-compute[75235]:   </metadata>
Nov 29 19:15:52 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:15:52 user nova-compute[75235]:     <system>
Nov 29 19:15:52 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:15:52 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:15:52 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:15:52 user nova-compute[75235]:       <entry name="serial">2270adba-8fe5-4334-83c3-0adf678b22fd</entry>
Nov 29 19:15:52 user nova-compute[75235]:       <entry name="uuid">2270adba-8fe5-4334-83c3-0adf678b22fd</entry>
Nov 29 19:15:52 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:15:52 user nova-compute[75235]:     </system>
Nov 29 19:15:52 user nova-compute[75235]:   </sysinfo>
Nov 29 19:15:52 user nova-compute[75235]:   <os>
Nov 29 19:15:52 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:15:52 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:15:52 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:15:52 user nova-compute[75235]:   </os>
Nov 29 19:15:52 user nova-compute[75235]:   <features>
Nov 29 19:15:52 user nova-compute[75235]:     <acpi/>
Nov 29 19:15:52 user nova-compute[75235]:     <apic/>
Nov 29 19:15:52 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:15:52 user nova-compute[75235]:   </features>
Nov 29 19:15:52 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:15:52 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:15:52 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:15:52 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:15:52 user nova-compute[75235]:   </clock>
Nov 29 19:15:52 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:15:52 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:15:52 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:15:52 user nova-compute[75235]:   </cpu>
Nov 29 19:15:52 user nova-compute[75235]:   <devices>
Nov 29 19:15:52 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:15:52 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:15:52 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk"/>
Nov 29 19:15:52 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:15:52 user nova-compute[75235]:     </disk>
Nov 29 19:15:52 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:15:52 user nova-compute[75235]:       <mac address="fa:16:3e:d1:d8:47"/>
Nov 29 19:15:52 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:15:52 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:15:52 user nova-compute[75235]:       <target dev="tap6b034b10-f8"/>
Nov 29 19:15:52 user nova-compute[75235]:     </interface>
Nov 29 19:15:52 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:15:52 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/console.log" append="off"/>
Nov 29 19:15:52 user nova-compute[75235]:     </serial>
Nov 29 19:15:52 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:15:52 user nova-compute[75235]:     <video>
Nov 29 19:15:52 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:15:52 user nova-compute[75235]:     </video>
Nov 29 19:15:52 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:15:52 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:15:52 user nova-compute[75235]:     </rng>
Nov 29 19:15:52 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:15:52 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:15:52 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:15:52 user nova-compute[75235]:     </memballoon>
Nov 29 19:15:52 user nova-compute[75235]:   </devices>
Nov 29 19:15:52 user nova-compute[75235]: </domain>
Nov 29 19:15:52 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557921067',display_name='tempest-TestMinimumBasicScenario-server-557921067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-557921067',id=34,image_ref='f6fe8492-a62d-4248-ace4-7c82a6e037c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfcdEytz1BIzpr4je2pqaAYwIUGawBipy6BMPyUsJ65Iow2QkVmTiOiMvhdfOc22t1CjDne4kQoDJtgiUcLGcanLkCfMprIdUMnqCkVIiPSEMm1lMAsvTgNSDQ0s65eg==',key_name='tempest-TestMinimumBasicScenario-1043254627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0hdo86rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f6fe8492-a62d-4248-ace4-7c82a6e037c8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:15:50Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=2270adba-8fe5-4334-83c3-0adf678b22fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG os_vif [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49a83742-7318-595f-9b0a-327925d8a90b', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b034b10-f8, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b034b10-f8, col_values=(('qos', UUID('96635890-9b9e-4cd0-b3be-80ea5a21d060')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b034b10-f8, col_values=(('external_ids', {'iface-id': '6b034b10-f86b-4912-a6df-b9c5334a816c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:d8:47', 'vm-uuid': '2270adba-8fe5-4334-83c3-0adf678b22fd'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:52 user nova-compute[75235]: INFO os_vif [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8')
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No VIF found with MAC fa:16:3e:d1:d8:47, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updated VIF entry in instance network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:15:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e6e282b2-51bc-4262-a306-11c59f71c3dd req-28d4ae61-c9c1-4b17-a33d-85682a8c2316 service nova] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-389a979c-6bbc-4123-bd61-47978cb50cd0 req-3d36d5ce-cce7-4bc4-aa64-74c23a329df0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-389a979c-6bbc-4123-bd61-47978cb50cd0 req-3d36d5ce-cce7-4bc4-aa64-74c23a329df0 service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-389a979c-6bbc-4123-bd61-47978cb50cd0 req-3d36d5ce-cce7-4bc4-aa64-74c23a329df0 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-389a979c-6bbc-4123-bd61-47978cb50cd0 req-3d36d5ce-cce7-4bc4-aa64-74c23a329df0 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-389a979c-6bbc-4123-bd61-47978cb50cd0 req-3d36d5ce-cce7-4bc4-aa64-74c23a329df0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:54 user nova-compute[75235]: WARNING nova.compute.manager [req-389a979c-6bbc-4123-bd61-47978cb50cd0 req-3d36d5ce-cce7-4bc4-aa64-74c23a329df0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state building and task_state spawning.
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bad0040-bd4b-4529-bdaa-41cd2b05ab1f req-2757cbc2-5da7-4d7b-b938-11966d66cde3 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bad0040-bd4b-4529-bdaa-41cd2b05ab1f req-2757cbc2-5da7-4d7b-b938-11966d66cde3 service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bad0040-bd4b-4529-bdaa-41cd2b05ab1f req-2757cbc2-5da7-4d7b-b938-11966d66cde3 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9bad0040-bd4b-4529-bdaa-41cd2b05ab1f req-2757cbc2-5da7-4d7b-b938-11966d66cde3 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-9bad0040-bd4b-4529-bdaa-41cd2b05ab1f req-2757cbc2-5da7-4d7b-b938-11966d66cde3 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:15:56 user nova-compute[75235]: WARNING nova.compute.manager [req-9bad0040-bd4b-4529-bdaa-41cd2b05ab1f req-2757cbc2-5da7-4d7b-b938-11966d66cde3 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state building and task_state spawning.
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:15:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance spawned successfully.
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:15:56 user nova-compute[75235]: INFO nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 29 19:15:56 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:15:56 user nova-compute[75235]: INFO nova.compute.manager [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Took 7.88 seconds to build instance.
Nov 29 19:15:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abae04f3-55c3-419d-b308-e61e6d1c8844 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.031s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:15:57 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviUaRbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:15:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:15:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:15:58 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[271cb5e1-c17d-42b5-a378-1f981edfa4b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:15:58 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2112a447-56be-48e0-b135-6811f73b1abb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292] added
Nov 29 19:15:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a5e044-188d-4046-acf0-5f959123e519]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b50d65-c969-4dae-b03a-16aecbac5d95]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nviUaRbL {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nviUaRbL" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c18cad5-014c-48e4-be95-5dbb02c40f07]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nviUaRbL'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6510d056-158d-4dc7-a711-7c0186e6ca5f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b20d5bd-debe-4e4e-bcb4-5b55382306a7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[861699a9-f99d-4ad3-9737-6ead01273d7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260]
Nov 29 19:15:58 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260] successful.
Nov 29 19:15:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b3161-9337-4273-9aac-5378679ecc26]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f023e4-f558-417e-8cf6-7209c327e9e5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 (non-flash)
Nov 29 19:15:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fe242-8bd3-4aac-931a-c6fee381e779]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviUaRbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23839616630376663', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839616630376663', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'flavor' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:15:59 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:15:59 user nova-compute[75235]:   <source dev="/dev/sdd"/>
Nov 29 19:15:59 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:15:59 user nova-compute[75235]:   <serial>ca855044-4065-4bc9-a20e-64253557c292</serial>
Nov 29 19:15:59 user nova-compute[75235]: </disk>
Nov 29 19:15:59 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:15:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] No VIF found with MAC fa:16:3e:ad:80:4e, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a2fd8389-0a06-43b2-befd-9fd0448574f1 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.448s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:01 user nova-compute[75235]: INFO nova.compute.manager [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Detaching volume ca855044-4065-4bc9-a20e-64253557c292
Nov 29 19:16:01 user nova-compute[75235]: INFO nova.virt.block_device [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attempting to driver detach volume ca855044-4065-4bc9-a20e-64253557c292 from mountpoint /dev/vdc
Nov 29 19:16:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Attempting to detach device vdc from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:16:01 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:16:01 user nova-compute[75235]:   <source dev="/dev/sdd"/>
Nov 29 19:16:01 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:16:01 user nova-compute[75235]:   <serial>ca855044-4065-4bc9-a20e-64253557c292</serial>
Nov 29 19:16:01 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 19:16:01 user nova-compute[75235]: </disk>
Nov 29 19:16:01 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:16:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Successfully detached device vdc from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the persistent domain config.
Nov 29 19:16:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:16:01 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:16:01 user nova-compute[75235]:   <source dev="/dev/sdd"/>
Nov 29 19:16:01 user nova-compute[75235]:   <target dev="vdc" bus="virtio"/>
Nov 29 19:16:01 user nova-compute[75235]:   <serial>ca855044-4065-4bc9-a20e-64253557c292</serial>
Nov 29 19:16:01 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 19:16:01 user nova-compute[75235]: </disk>
Nov 29 19:16:01 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:16:02 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:16:02 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7757MB free_disk=25.088298797607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Applying migration context for instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 as it has an incoming, in-progress migration 1846064e-85fb-4934-a771-396fd5fd2859. Migration status is finished {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 19:16:02 user nova-compute[75235]: INFO nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating resource usage from migration 1846064e-85fb-4934-a771-396fd5fd2859
Nov 29 19:16:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8d3d1884-0135-490c-bca5-1672b8d64884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Migration 1846064e-85fb-4934-a771-396fd5fd2859 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2270adba-8fe5-4334-83c3-0adf678b22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:16:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:04 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:04 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:16:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:10 user nova-compute[75235]: INFO nova.compute.manager [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Unrescuing
Nov 29 19:16:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:16:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:16:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'flavor' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fb9bc62-ebf1-4c50-8930-b2e9dcb7b83b req-b6453769-20a3-4245-9a49-4f7fed218f49 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fb9bc62-ebf1-4c50-8930-b2e9dcb7b83b req-b6453769-20a3-4245-9a49-4f7fed218f49 service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fb9bc62-ebf1-4c50-8930-b2e9dcb7b83b req-b6453769-20a3-4245-9a49-4f7fed218f49 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fb9bc62-ebf1-4c50-8930-b2e9dcb7b83b req-b6453769-20a3-4245-9a49-4f7fed218f49 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fb9bc62-ebf1-4c50-8930-b2e9dcb7b83b req-b6453769-20a3-4245-9a49-4f7fed218f49 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:16:11 user nova-compute[75235]: WARNING nova.compute.manager [req-5fb9bc62-ebf1-4c50-8930-b2e9dcb7b83b req-b6453769-20a3-4245-9a49-4f7fed218f49 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:16:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:12 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance destroyed successfully.
Nov 29 19:16:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c64d613-21e3-4227-88b7-c8ba4122d987 req-f2f4e21c-830d-4c3e-83f0-6562e7d2055b service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:16:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c64d613-21e3-4227-88b7-c8ba4122d987 req-f2f4e21c-830d-4c3e-83f0-6562e7d2055b service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c64d613-21e3-4227-88b7-c8ba4122d987 req-f2f4e21c-830d-4c3e-83f0-6562e7d2055b service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c64d613-21e3-4227-88b7-c8ba4122d987 req-f2f4e21c-830d-4c3e-83f0-6562e7d2055b service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c64d613-21e3-4227-88b7-c8ba4122d987 req-f2f4e21c-830d-4c3e-83f0-6562e7d2055b service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:16:13 user nova-compute[75235]: WARNING nova.compute.manager [req-1c64d613-21e3-4227-88b7-c8ba4122d987 req-f2f4e21c-830d-4c3e-83f0-6562e7d2055b service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:16:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:16:16 user nova-compute[75235]: WARNING nova.compute.manager [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:16:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:16:16 user nova-compute[75235]: WARNING nova.compute.manager [req-6955eb92-014a-4007-8e30-385130780ced req-8b75e485-584e-4dc7-a36b-3b9febd660f5 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:16:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-6349532a-6288-4ecd-a5ba-107143d57285 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:16:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8d3d1884-0135-490c-bca5-1672b8d64884 is timed out.
Nov 29 19:16:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Successfully detached device vdc from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the live domain config.
Nov 29 19:16:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nviUaRbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:16:22 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcb3b48-02d1-4bea-b5da-245abf196472]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc8a231b-fead-4d1e-a5d4-5411c8ca2f8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:354e4173-71c9-4543-9586-ce41621823fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:16:22 user nova-compute[75235]: No targets found.
Nov 29 19:16:22 user nova-compute[75235]: iSNS:
Nov 29 19:16:22 user nova-compute[75235]: No targets found.
Nov 29 19:16:22 user nova-compute[75235]: STATIC:
Nov 29 19:16:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:bc8a231b-fead-4d1e-a5d4-5411c8ca2f8a
Nov 29 19:16:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:16:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:16:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:354e4173-71c9-4543-9586-ce41621823fc
Nov 29 19:16:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:16:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:16:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292
Nov 29 19:16:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:16:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:16:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55
Nov 29 19:16:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:16:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:16:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:16:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:16:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:16:22 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06
Nov 29 19:16:22 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:16:22 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:16:22 user nova-compute[75235]: FIRMWARE:
Nov 29 19:16:22 user nova-compute[75235]: No targets found.
Nov 29 19:16:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:16:22 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:16:22 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286ab46-00a9-442c-9856-f1dfe40005bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354e4173-71c9-4543-9586-ce41621823fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc8a231b-fead-4d1e-a5d4-5411c8ca2f8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1107d24b-ee85-464a-87ad-7f2c0e0840ca]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354e4173-71c9-4543-9586-ce41621823fc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc8a231b-fead-4d1e-a5d4-5411c8ca2f8a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354e4173-71c9-4543-9586-ce41621823fc (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc8a231b-fead-4d1e-a5d4-5411c8ca2f8a (non-flash)
Nov 29 19:16:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354e4173-71c9-4543-9586-ce41621823fc (non-flash)
Nov 29 19:16:22 user nova-compute[75235]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc8a231b-fead-4d1e-a5d4-5411c8ca2f8a (non-flash)
Nov 29 19:16:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56624aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea739f-3134-4584-be71-667124d6b48d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99274d7-70fc-4bbe-ab44-d244f69bd7ff]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e57ef8-5eb9-48ef-916e-11aac9ccc816]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e99926d-0739-4b36-b77e-a2f2d57bae6d]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c5467f-cdc5-4757-8e83-1e0a99d6e651]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb3cba6-a251-453a-bfb2-6854cd66a9b1]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260]
Nov 29 19:16:22 user nova-compute[75235]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292, portal: 172.16.0.220,3260] successful.
Nov 29 19:16:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca855044-4065-4bc9-a20e-64253557c292 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408f1fc-7856-44a7-a0dc-162148be3863]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] <== disconnect_volume: return (392ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:16:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:16:23 user nova-compute[75235]: DEBUG nova.objects.instance [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'flavor' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:16:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-987cd152-5207-4a1a-aa1a-604d1042303b tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Going to confirm migration 2 {{(pid=75235) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'info_cache' on Instance uuid a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'migration_context' on Instance uuid a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG nova.objects.base [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Object Instance<a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487> lazy-loaded attributes: info_cache,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:30 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:16:30 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:16:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.521s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:30 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Deleted allocation for migration 1846064e-85fb-4934-a771-396fd5fd2859
Nov 29 19:16:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bf9bc2d1-1962-4d81-91e8-db35b298d457 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.953s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:52 user nova-compute[75235]: INFO nova.compute.manager [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Detaching volume 38861818-0b73-4a09-8985-486228cabe55
Nov 29 19:16:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:52 user nova-compute[75235]: INFO nova.virt.block_device [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Attempting to driver detach volume 38861818-0b73-4a09-8985-486228cabe55 from mountpoint /dev/vdb
Nov 29 19:16:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Attempting to detach device vdb from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:16:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:16:52 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:16:52 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:16:52 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:16:52 user nova-compute[75235]:   <serial>38861818-0b73-4a09-8985-486228cabe55</serial>
Nov 29 19:16:52 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:16:52 user nova-compute[75235]: </disk>
Nov 29 19:16:52 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:16:52 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Successfully detached device vdb from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the persistent domain config.
Nov 29 19:16:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:16:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:16:52 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:16:52 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:16:52 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:16:52 user nova-compute[75235]:   <serial>38861818-0b73-4a09-8985-486228cabe55</serial>
Nov 29 19:16:52 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:16:52 user nova-compute[75235]: </disk>
Nov 29 19:16:52 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:16:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:16:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:16:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:16:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:16:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:16:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:16:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:16:58 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:16:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:16:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:16:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:16:58 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:16:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:16:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:17:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:02 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:17:02 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7787MB free_disk=25.054462432861328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 8d3d1884-0135-490c-bca5-1672b8d64884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2270adba-8fe5-4334-83c3-0adf678b22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:17:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.826s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:03 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updating instance_info_cache with network_info: [{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:17:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:17:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:17:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:13 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d3d1884-0135-490c-bca5-1672b8d64884 is timed out.
Nov 29 19:17:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Successfully detached device vdb from instance 8d3d1884-0135-490c-bca5-1672b8d64884 from the live domain config.
Nov 29 19:17:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqHEUbsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:17:13 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[312e6864-288b-47f7-8008-3edd6006244e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:17:13 user nova-compute[75235]: No targets found.
Nov 29 19:17:13 user nova-compute[75235]: iSNS:
Nov 29 19:17:13 user nova-compute[75235]: No targets found.
Nov 29 19:17:13 user nova-compute[75235]: STATIC:
Nov 29 19:17:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55
Nov 29 19:17:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:17:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:17:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:17:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:17:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:17:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06
Nov 29 19:17:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:17:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:17:13 user nova-compute[75235]: FIRMWARE:
Nov 29 19:17:13 user nova-compute[75235]: No targets found.
Nov 29 19:17:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:17:13 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:17:13 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1eb72-2007-4137-8a85-f46ec44f1ae0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[08064ddc-73a2-4ced-a9ff-5e46385f2548]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:17:13 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:17:13 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:17:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:17:13 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:17:13 user nova-compute[75235]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 (non-flash)
Nov 29 19:17:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c709240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d4308f-c4ec-4cdb-940c-bfcab4e1d231]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180ca1c-43f7-4c06-b13f-832421bdb9c7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c904fd7-105e-46a5-9f77-0813e4de555d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1217d30-c5d3-42f2-9cc0-16e0ef211e99]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b700032a-36ef-4060-b3b7-c41c3625d308]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e623e-356b-4316-b3e3-214550caa2f4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260]
Nov 29 19:17:13 user nova-compute[75235]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55, portal: 172.16.0.220,3260] successful.
Nov 29 19:17:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38861818-0b73-4a09-8985-486228cabe55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395f7ba-4097-473e-a4de-6291341dc3a5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] <== disconnect_volume: return (304ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:17:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:17:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'flavor' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:17:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4e0614d8-a092-4897-ad95-549bf39287c4 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.674s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:17:14 user nova-compute[75235]: INFO nova.compute.manager [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] instance snapshotting
Nov 29 19:17:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Beginning live snapshot process
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.207s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph96hlf6m/d0f3c688ea6e4a5ebf42d39a018c447b.delta 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph96hlf6m/d0f3c688ea6e4a5ebf42d39a018c447b.delta 1073741824" returned: 0 in 0.052s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:15 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 19:17:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:17:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:17:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 19:17:17 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:17:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph96hlf6m/d0f3c688ea6e4a5ebf42d39a018c447b.delta /opt/stack/data/nova/instances/snapshots/tmph96hlf6m/d0f3c688ea6e4a5ebf42d39a018c447b {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph96hlf6m/d0f3c688ea6e4a5ebf42d39a018c447b.delta /opt/stack/data/nova/instances/snapshots/tmph96hlf6m/d0f3c688ea6e4a5ebf42d39a018c447b" returned: 0 in 0.516s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Snapshot extracted, beginning image upload
Nov 29 19:17:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:20 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Snapshot image upload complete
Nov 29 19:17:20 user nova-compute[75235]: INFO nova.compute.manager [None req-c34a66d2-672c-4416-8ba2-f0dd1f2510bb tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Took 5.24 seconds to snapshot the instance on the hypervisor.
Nov 29 19:17:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:17:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid c1d8be89-d905-43dc-8d73-4632fa1e7227 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 9d57cb98-5640-4104-ab59-fc0f4786433c {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "c0628a53-2856-47c2-8b64-651c656f9d93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "c0628a53-2856-47c2-8b64-651c656f9d93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG nova.objects.instance [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'flavor' on Instance uuid 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:42 user nova-compute[75235]: INFO nova.compute.manager [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Attaching volume 9bcbbe88-6093-4d35-948e-4996962b0954 to /dev/vdb
Nov 29 19:17:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG os_brick.utils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29808a-15b6-4cbb-a752-16b30977c93b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8827b87f-ec3f-4930-8e88-d1fc36cbc071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2161b2dd-b110-4781-b333-894613b4fa11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2c2e7-e11a-4933-a28f-c87033929b13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:17:42 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[46044328-8f46-4d33-a4e9-7ed6def928f1]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG os_brick.utils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating existing volume attachment record: 0e56b84c-52f4-4bdf-b4c0-99584d5d2e56 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:42 user nova-compute[75235]: INFO nova.compute.manager [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Terminating instance
Nov 29 19:17:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-557ec3b5-a96e-40d8-9254-f204ef3e64ba req-1bc93611-7813-4ff6-9461-fb099143fe1b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-vif-unplugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-557ec3b5-a96e-40d8-9254-f204ef3e64ba req-1bc93611-7813-4ff6-9461-fb099143fe1b service nova] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-557ec3b5-a96e-40d8-9254-f204ef3e64ba req-1bc93611-7813-4ff6-9461-fb099143fe1b service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-557ec3b5-a96e-40d8-9254-f204ef3e64ba req-1bc93611-7813-4ff6-9461-fb099143fe1b service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-557ec3b5-a96e-40d8-9254-f204ef3e64ba req-1bc93611-7813-4ff6-9461-fb099143fe1b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] No waiting events found dispatching network-vif-unplugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-557ec3b5-a96e-40d8-9254-f204ef3e64ba req-1bc93611-7813-4ff6-9461-fb099143fe1b service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-vif-unplugged-0140779b-6c22-42a4-a580-f41c9098ab4e for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:17:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Instance destroyed successfully.
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.objects.instance [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lazy-loading 'resources' on Instance uuid 8d3d1884-0135-490c-bca5-1672b8d64884 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-652622122',display_name='tempest-TestServerVolumeAttachmentScenario-server-652622122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-652622122',id=32,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMczScZup3A7TjDxjd3laaqATiuxS0B8QPWG0L4pVwkjQrc+KA157tSSyCebqlOQoLazvKWJu61eWMAJd/rhXFAhmQzAhlbs49QuaBLd4e20mIFq5HfDRH5CJWdlYJLJlQ==',key_name='tempest-keypair-1413679644',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:13:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf499ae51bcf4e1592cac24df33ff6ea',ramdisk_id='',reservation_id='r-b0s2ppke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-432609267',owner_user_name='tempest-TestServerVolumeAttachmentScenario-432609267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ef2c4e50a09485f99d6f132c4857491',uuid=8d3d1884-0135-490c-bca5-1672b8d64884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Converting VIF {"id": "0140779b-6c22-42a4-a580-f41c9098ab4e", "address": "fa:16:3e:ad:80:4e", "network": {"id": "8e583960-8683-4829-88ce-f5720f2a4773", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-923047394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf499ae51bcf4e1592cac24df33ff6ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0140779b-6c", "ovs_interfaceid": "0140779b-6c22-42a4-a580-f41c9098ab4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG os_vif [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0140779b-6c, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0931b82-f426-43a1-901f-4d25e61b8e55) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:43 user nova-compute[75235]: INFO os_vif [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:80:4e,bridge_name='br-int',has_traffic_filtering=True,id=0140779b-6c22-42a4-a580-f41c9098ab4e,network=Network(8e583960-8683-4829-88ce-f5720f2a4773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0140779b-6c')
Nov 29 19:17:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Deleting instance files /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884_del
Nov 29 19:17:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Deletion of /opt/stack/data/nova/instances/8d3d1884-0135-490c-bca5-1672b8d64884_del complete
Nov 29 19:17:43 user nova-compute[75235]: INFO nova.compute.manager [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 19:17:43 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:17:43 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:17:44 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:17:44 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Took 0.91 seconds to deallocate network for instance.
Nov 29 19:17:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:45 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Deleted allocations for instance 8d3d1884-0135-490c-bca5-1672b8d64884
Nov 29 19:17:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-180bb4de-587a-4c29-b104-098260fbfc92 tempest-TestServerVolumeAttachmentScenario-432609267 tempest-TestServerVolumeAttachmentScenario-432609267-project-member] Lock "8d3d1884-0135-490c-bca5-1672b8d64884" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] Acquiring lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] Lock "8d3d1884-0135-490c-bca5-1672b8d64884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] No waiting events found dispatching network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:17:45 user nova-compute[75235]: WARNING nova.compute.manager [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received unexpected event network-vif-plugged-0140779b-6c22-42a4-a580-f41c9098ab4e for instance with vm_state deleted and task_state None.
Nov 29 19:17:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-de5471b9-2885-4772-9d90-e10b1681bbd3 req-a495d197-c3c7-4dbf-a9d9-97257394e68d service nova] [instance: 8d3d1884-0135-490c-bca5-1672b8d64884] Received event network-vif-deleted-0140779b-6c22-42a4-a580-f41c9098ab4e {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:17:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxFuYXBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:17:50 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:17:50 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:17:50 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[544bec42-a195-49f1-ab4c-59eaf70f348e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:17:50 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f174a-0026-463e-8c2c-7e52212f1b7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954] added
Nov 29 19:17:50 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7929640b-a0c9-45fc-b600-0efcc83f141e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4aa49b-9cb6-46b5-a2d2-e40a97210e26]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxFuYXBd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxFuYXBd" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[83530d83-6bd1-4bb8-9728-1353c3325019]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxFuYXBd'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8b219-6270-43a5-9e70-0fbbd0d28dfa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[51937b8c-7f57-4b21-ab97-b428991c5aa2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d63983e-b541-4049-b4ef-0dbaed1c4846]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260]
Nov 29 19:17:50 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260] successful.
Nov 29 19:17:50 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a012cc69-778f-4fd3-bdb4-c4c28dfa08aa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d805f3e-1782-42a5-9976-cd95d3322940]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:17:50 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d1cdf0-8ab9-482d-b47d-6c05c6efd8e4]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:17:50 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxFuYXBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23034303663353936', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034303663353936', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG nova.objects.instance [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'flavor' on Instance uuid 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:17:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:17:51 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:17:51 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:17:51 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:17:51 user nova-compute[75235]:   <serial>9bcbbe88-6093-4d35-948e-4996962b0954</serial>
Nov 29 19:17:51 user nova-compute[75235]: </disk>
Nov 29 19:17:51 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:17:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:17:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:17:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] No VIF found with MAC fa:16:3e:d1:d8:47, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:17:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-14bde94b-1c6e-491a-b885-1d44cdc989ff tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.892s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing instance network info cache due to event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG nova.network.neutron [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG nova.network.neutron [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updated VIF entry in instance network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG nova.network.neutron [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:17:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b839bb78-dcc4-4054-ae4c-2b246dffecfc req-5fb5ccf3-d05a-4240-a7f3-12b4cc0d1993 service nova] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing instance network info cache due to event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:57 user nova-compute[75235]: INFO nova.compute.manager [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Rebooting instance
Nov 29 19:17:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updated VIF entry in instance network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55d5a160-df2c-4666-8d79-8f4fddea2fc6 req-070eb7a8-e37c-47e0-b827-0a4f72a1c183 service nova] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:17:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:17:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:17:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-609bbcbb-68c0-43f9-a47a-f009c6e2f082 req-4c8c63f2-ab71-4230-9029-9401a9853a48 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-unplugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-609bbcbb-68c0-43f9-a47a-f009c6e2f082 req-4c8c63f2-ab71-4230-9029-9401a9853a48 service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-609bbcbb-68c0-43f9-a47a-f009c6e2f082 req-4c8c63f2-ab71-4230-9029-9401a9853a48 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-609bbcbb-68c0-43f9-a47a-f009c6e2f082 req-4c8c63f2-ab71-4230-9029-9401a9853a48 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-609bbcbb-68c0-43f9-a47a-f009c6e2f082 req-4c8c63f2-ab71-4230-9029-9401a9853a48 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-unplugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:01 user nova-compute[75235]: WARNING nova.compute.manager [req-609bbcbb-68c0-43f9-a47a-f009c6e2f082 req-4c8c63f2-ab71-4230-9029-9401a9853a48 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-unplugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state active and task_state reboot_started.
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance shutdown successfully.
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:18:03 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:03 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8101MB free_disk=25.014789581298828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-58332f5b-d142-4398-a72a-0c7c4f5aa85c req-00f48dd6-e264-4319-a9c0-c5add571c679 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58332f5b-d142-4398-a72a-0c7c4f5aa85c req-00f48dd6-e264-4319-a9c0-c5add571c679 service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58332f5b-d142-4398-a72a-0c7c4f5aa85c req-00f48dd6-e264-4319-a9c0-c5add571c679 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58332f5b-d142-4398-a72a-0c7c4f5aa85c req-00f48dd6-e264-4319-a9c0-c5add571c679 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-58332f5b-d142-4398-a72a-0c7c4f5aa85c req-00f48dd6-e264-4319-a9c0-c5add571c679 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:03 user nova-compute[75235]: WARNING nova.compute.manager [req-58332f5b-d142-4398-a72a-0c7c4f5aa85c req-00f48dd6-e264-4319-a9c0-c5add571c679 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state active and task_state reboot_started.
Nov 29 19:18:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2270adba-8fe5-4334-83c3-0adf678b22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:05 user nova-compute[75235]: WARNING nova.compute.manager [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state active and task_state reboot_started.
Nov 29 19:18:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:05 user nova-compute[75235]: WARNING nova.compute.manager [req-5abbd436-3074-458c-a7e4-c90b9840d2df req-f9793121-8ac3-4d8e-93b4-96a745506274 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state active and task_state reboot_started.
Nov 29 19:18:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance running successfully.
Nov 29 19:18:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance soft rebooted successfully.
Nov 29 19:18:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:18:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7935e03b-4205-4421-a0ff-6ff52b7b0bdb tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.909s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:06 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:18:06 user nova-compute[75235]: INFO nova.compute.claims [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Claim successful on node user
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:18:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.policy [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b09701817c0147aca7432e1329b82300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77e6e9f44ec4c76b5c8f8f29c7e651f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:18:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Creating image(s)
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.341s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.288s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk 1073741824" returned: 0 in 0.049s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Cannot resize image /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Ensure instance console log exists: /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Successfully created port: 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:18:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Successfully updated port: 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing instance network info cache due to event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance network_info: |[{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.network.neutron [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:18:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Start _get_guest_xml network_info=[{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:18:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-882513022',display_name='tempest-ServerRescueNegativeTestJSON-server-882513022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-882513022',id=35,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL4pdw6IxotoOWuh3YJnAWGaYdR2hnd7TFyyshEjvsUyltlIzZHO7qD0suc5S1bneaKKS89VqCKW2RuVN5J6i2ZkaTDeUvb7RLp5hgvfOGmV5Og0dGHAi8IamaCRLJ12Q==',key_name='tempest-keypair-1426874437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-6qa0hs2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b09701817c0147aca7432e1329b82300',uuid=87f07af2-b1c8-47cd-be42-786dd4ee8f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:18:11 user nova-compute[75235]:   <uuid>87f07af2-b1c8-47cd-be42-786dd4ee8f2c</uuid>
Nov 29 19:18:11 user nova-compute[75235]:   <name>instance-00000023</name>
Nov 29 19:18:11 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:18:11 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:18:11 user nova-compute[75235]:   <metadata>
Nov 29 19:18:11 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:18:11 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:18:11 user nova-compute[75235]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-882513022</nova:name>
Nov 29 19:18:11 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:18:10</nova:creationTime>
Nov 29 19:18:11 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:18:11 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:18:11 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:18:11 user nova-compute[75235]:       <nova:owner>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:user uuid="b09701817c0147aca7432e1329b82300">tempest-ServerRescueNegativeTestJSON-1726326315-project-member</nova:user>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:project uuid="a77e6e9f44ec4c76b5c8f8f29c7e651f">tempest-ServerRescueNegativeTestJSON-1726326315</nova:project>
Nov 29 19:18:11 user nova-compute[75235]:       </nova:owner>
Nov 29 19:18:11 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:18:11 user nova-compute[75235]:       <nova:ports>
Nov 29 19:18:11 user nova-compute[75235]:         <nova:port uuid="51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c">
Nov 29 19:18:11 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 19:18:11 user nova-compute[75235]:         </nova:port>
Nov 29 19:18:11 user nova-compute[75235]:       </nova:ports>
Nov 29 19:18:11 user nova-compute[75235]:     </nova:instance>
Nov 29 19:18:11 user nova-compute[75235]:   </metadata>
Nov 29 19:18:11 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:18:11 user nova-compute[75235]:     <system>
Nov 29 19:18:11 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:18:11 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:18:11 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:18:11 user nova-compute[75235]:       <entry name="serial">87f07af2-b1c8-47cd-be42-786dd4ee8f2c</entry>
Nov 29 19:18:11 user nova-compute[75235]:       <entry name="uuid">87f07af2-b1c8-47cd-be42-786dd4ee8f2c</entry>
Nov 29 19:18:11 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:18:11 user nova-compute[75235]:     </system>
Nov 29 19:18:11 user nova-compute[75235]:   </sysinfo>
Nov 29 19:18:11 user nova-compute[75235]:   <os>
Nov 29 19:18:11 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:18:11 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:18:11 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:18:11 user nova-compute[75235]:   </os>
Nov 29 19:18:11 user nova-compute[75235]:   <features>
Nov 29 19:18:11 user nova-compute[75235]:     <acpi/>
Nov 29 19:18:11 user nova-compute[75235]:     <apic/>
Nov 29 19:18:11 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:18:11 user nova-compute[75235]:   </features>
Nov 29 19:18:11 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:18:11 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:18:11 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:18:11 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:18:11 user nova-compute[75235]:   </clock>
Nov 29 19:18:11 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:18:11 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:18:11 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:18:11 user nova-compute[75235]:   </cpu>
Nov 29 19:18:11 user nova-compute[75235]:   <devices>
Nov 29 19:18:11 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:18:11 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:18:11 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk"/>
Nov 29 19:18:11 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:18:11 user nova-compute[75235]:     </disk>
Nov 29 19:18:11 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:18:11 user nova-compute[75235]:       <mac address="fa:16:3e:b5:d3:6c"/>
Nov 29 19:18:11 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:18:11 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:18:11 user nova-compute[75235]:       <target dev="tap51fc0d05-ce"/>
Nov 29 19:18:11 user nova-compute[75235]:     </interface>
Nov 29 19:18:11 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:18:11 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/console.log" append="off"/>
Nov 29 19:18:11 user nova-compute[75235]:     </serial>
Nov 29 19:18:11 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:18:11 user nova-compute[75235]:     <video>
Nov 29 19:18:11 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:18:11 user nova-compute[75235]:     </video>
Nov 29 19:18:11 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:18:11 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:18:11 user nova-compute[75235]:     </rng>
Nov 29 19:18:11 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:18:11 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:18:11 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:18:11 user nova-compute[75235]:     </memballoon>
Nov 29 19:18:11 user nova-compute[75235]:   </devices>
Nov 29 19:18:11 user nova-compute[75235]: </domain>
Nov 29 19:18:11 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-882513022',display_name='tempest-ServerRescueNegativeTestJSON-server-882513022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-882513022',id=35,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL4pdw6IxotoOWuh3YJnAWGaYdR2hnd7TFyyshEjvsUyltlIzZHO7qD0suc5S1bneaKKS89VqCKW2RuVN5J6i2ZkaTDeUvb7RLp5hgvfOGmV5Og0dGHAi8IamaCRLJ12Q==',key_name='tempest-keypair-1426874437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-6qa0hs2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b09701817c0147aca7432e1329b82300',uuid=87f07af2-b1c8-47cd-be42-786dd4ee8f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG os_vif [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f5c1a74-52d7-5928-bf66-1be1b1842390', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51fc0d05-ce, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51fc0d05-ce, col_values=(('qos', UUID('229188e1-a655-47fa-8cfc-793aa6ea234f')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51fc0d05-ce, col_values=(('external_ids', {'iface-id': '51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:d3:6c', 'vm-uuid': '87f07af2-b1c8-47cd-be42-786dd4ee8f2c'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:11 user nova-compute[75235]: INFO os_vif [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce')
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:b5:d3:6c, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updated VIF entry in instance network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG nova.network.neutron [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13c6a81c-131a-4628-9329-c50eda21ec0d req-cf6f9d5d-e058-45f6-b10a-17133bcbd6ea service nova] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:18:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance spawned successfully.
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:14 user nova-compute[75235]: INFO nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 29 19:18:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:18:14 user nova-compute[75235]: INFO nova.compute.manager [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Took 8.01 seconds to build instance.
Nov 29 19:18:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-598844d5-6deb-4bc8-b01b-41e522b294d8 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.139s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3a67bc17-3ae8-4163-9e85-1f9d07cbd734 req-4bec573d-5689-429c-af39-c6b393bb25a2 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3a67bc17-3ae8-4163-9e85-1f9d07cbd734 req-4bec573d-5689-429c-af39-c6b393bb25a2 service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3a67bc17-3ae8-4163-9e85-1f9d07cbd734 req-4bec573d-5689-429c-af39-c6b393bb25a2 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3a67bc17-3ae8-4163-9e85-1f9d07cbd734 req-4bec573d-5689-429c-af39-c6b393bb25a2 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-3a67bc17-3ae8-4163-9e85-1f9d07cbd734 req-4bec573d-5689-429c-af39-c6b393bb25a2 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:15 user nova-compute[75235]: WARNING nova.compute.manager [req-3a67bc17-3ae8-4163-9e85-1f9d07cbd734 req-4bec573d-5689-429c-af39-c6b393bb25a2 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state active and task_state None.
Nov 29 19:18:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-27c3bcaf-071a-4f59-9c36-5b7344712590 req-715a1339-897a-4679-bdcf-9e37746379e0 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-27c3bcaf-071a-4f59-9c36-5b7344712590 req-715a1339-897a-4679-bdcf-9e37746379e0 service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-27c3bcaf-071a-4f59-9c36-5b7344712590 req-715a1339-897a-4679-bdcf-9e37746379e0 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-27c3bcaf-071a-4f59-9c36-5b7344712590 req-715a1339-897a-4679-bdcf-9e37746379e0 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-27c3bcaf-071a-4f59-9c36-5b7344712590 req-715a1339-897a-4679-bdcf-9e37746379e0 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:17 user nova-compute[75235]: WARNING nova.compute.manager [req-27c3bcaf-071a-4f59-9c36-5b7344712590 req-715a1339-897a-4679-bdcf-9e37746379e0 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state active and task_state None.
Nov 29 19:18:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:20 user nova-compute[75235]: INFO nova.compute.manager [None req-a7f564b4-7131-4117-a7bc-57b21eb17609 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Get console output
Nov 29 19:18:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:18:20 user nova-compute[75235]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 19:18:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:18:20 user nova-compute[75235]: INFO nova.compute.claims [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Claim successful on node user
Nov 29 19:18:20 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.network.neutron [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:18:21 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.policy [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ded506037834e6783ff09742a34fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c6fb0f9a004400a2448ad9ecdf7b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:18:21 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Creating image(s)
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "/opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "/opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "/opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.193s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk 1073741824" returned: 0 in 0.053s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.network.neutron [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Successfully created port: 442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Cannot resize image /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Ensure instance console log exists: /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Successfully updated port: 442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquired lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-changed-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Refreshing instance network info cache due to event network-changed-442e2ec7-1fc5-414a-8dce-4b87e2c201c8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] Acquiring lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:18:22 user nova-compute[75235]: INFO nova.compute.claims [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Claim successful on node user
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating instance_info_cache with network_info: [{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Releasing lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Instance network_info: |[{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] Acquired lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Refreshing network info cache for port 442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Start _get_guest_xml network_info=[{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:18:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1775697525',display_name='tempest-TestStampPattern-server-1775697525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1775697525',id=36,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn3xVYo+E0cU9Uy/fU7QjtKHhvF/x6NUW0tu+5nR3jqZ7TBsLl5Pf/NwyWXbpCskpo3RJCjL48V0UetcFJscnJorQKUz2IcUOa+ov7qXiZkRoF+eVV193Dgm56Xr3HCCw==',key_name='tempest-TestStampPattern-1606459428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',ramdisk_id='',reservation_id='r-nygavnac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2015071819',owner_user_name='tempest-TestStampPattern-2015071819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:21Z,user_data=None,user_id='2ded506037834e6783ff09742a34fca0',uuid=a54d682f-41ac-4ab4-b622-3659d507016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:18:22 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converting VIF {"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.objects.instance [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'pci_devices' on Instance uuid a54d682f-41ac-4ab4-b622-3659d507016b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:18:23 user nova-compute[75235]:   <uuid>a54d682f-41ac-4ab4-b622-3659d507016b</uuid>
Nov 29 19:18:23 user nova-compute[75235]:   <name>instance-00000024</name>
Nov 29 19:18:23 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:18:23 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:18:23 user nova-compute[75235]:   <metadata>
Nov 29 19:18:23 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:18:23 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:18:23 user nova-compute[75235]:       <nova:name>tempest-TestStampPattern-server-1775697525</nova:name>
Nov 29 19:18:23 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:18:22</nova:creationTime>
Nov 29 19:18:23 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:18:23 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:18:23 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:18:23 user nova-compute[75235]:       <nova:owner>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:user uuid="2ded506037834e6783ff09742a34fca0">tempest-TestStampPattern-2015071819-project-member</nova:user>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:project uuid="e4c6fb0f9a004400a2448ad9ecdf7b6e">tempest-TestStampPattern-2015071819</nova:project>
Nov 29 19:18:23 user nova-compute[75235]:       </nova:owner>
Nov 29 19:18:23 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:18:23 user nova-compute[75235]:       <nova:ports>
Nov 29 19:18:23 user nova-compute[75235]:         <nova:port uuid="442e2ec7-1fc5-414a-8dce-4b87e2c201c8">
Nov 29 19:18:23 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:18:23 user nova-compute[75235]:         </nova:port>
Nov 29 19:18:23 user nova-compute[75235]:       </nova:ports>
Nov 29 19:18:23 user nova-compute[75235]:     </nova:instance>
Nov 29 19:18:23 user nova-compute[75235]:   </metadata>
Nov 29 19:18:23 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:18:23 user nova-compute[75235]:     <system>
Nov 29 19:18:23 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:18:23 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:18:23 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:18:23 user nova-compute[75235]:       <entry name="serial">a54d682f-41ac-4ab4-b622-3659d507016b</entry>
Nov 29 19:18:23 user nova-compute[75235]:       <entry name="uuid">a54d682f-41ac-4ab4-b622-3659d507016b</entry>
Nov 29 19:18:23 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:18:23 user nova-compute[75235]:     </system>
Nov 29 19:18:23 user nova-compute[75235]:   </sysinfo>
Nov 29 19:18:23 user nova-compute[75235]:   <os>
Nov 29 19:18:23 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:18:23 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:18:23 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:18:23 user nova-compute[75235]:   </os>
Nov 29 19:18:23 user nova-compute[75235]:   <features>
Nov 29 19:18:23 user nova-compute[75235]:     <acpi/>
Nov 29 19:18:23 user nova-compute[75235]:     <apic/>
Nov 29 19:18:23 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:18:23 user nova-compute[75235]:   </features>
Nov 29 19:18:23 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:18:23 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:18:23 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:18:23 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:18:23 user nova-compute[75235]:   </clock>
Nov 29 19:18:23 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:18:23 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:18:23 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:18:23 user nova-compute[75235]:   </cpu>
Nov 29 19:18:23 user nova-compute[75235]:   <devices>
Nov 29 19:18:23 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:18:23 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:18:23 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk"/>
Nov 29 19:18:23 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:18:23 user nova-compute[75235]:     </disk>
Nov 29 19:18:23 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:18:23 user nova-compute[75235]:       <mac address="fa:16:3e:a4:ed:97"/>
Nov 29 19:18:23 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:18:23 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:18:23 user nova-compute[75235]:       <target dev="tap442e2ec7-1f"/>
Nov 29 19:18:23 user nova-compute[75235]:     </interface>
Nov 29 19:18:23 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:18:23 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/console.log" append="off"/>
Nov 29 19:18:23 user nova-compute[75235]:     </serial>
Nov 29 19:18:23 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:18:23 user nova-compute[75235]:     <video>
Nov 29 19:18:23 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:18:23 user nova-compute[75235]:     </video>
Nov 29 19:18:23 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:18:23 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:18:23 user nova-compute[75235]:     </rng>
Nov 29 19:18:23 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:18:23 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:18:23 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:18:23 user nova-compute[75235]:     </memballoon>
Nov 29 19:18:23 user nova-compute[75235]:   </devices>
Nov 29 19:18:23 user nova-compute[75235]: </domain>
Nov 29 19:18:23 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1775697525',display_name='tempest-TestStampPattern-server-1775697525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1775697525',id=36,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn3xVYo+E0cU9Uy/fU7QjtKHhvF/x6NUW0tu+5nR3jqZ7TBsLl5Pf/NwyWXbpCskpo3RJCjL48V0UetcFJscnJorQKUz2IcUOa+ov7qXiZkRoF+eVV193Dgm56Xr3HCCw==',key_name='tempest-TestStampPattern-1606459428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',ramdisk_id='',reservation_id='r-nygavnac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2015071819',owner_user_name='tempest-TestStampPattern-2015071819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:21Z,user_data=None,user_id='2ded506037834e6783ff09742a34fca0',uuid=a54d682f-41ac-4ab4-b622-3659d507016b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converting VIF {"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG os_vif [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f9269bb-01b3-54ae-89fe-8e02d1cdb05e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap442e2ec7-1f, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap442e2ec7-1f, col_values=(('qos', UUID('862e3ab3-5807-44e3-9d7e-583acae27f37')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap442e2ec7-1f, col_values=(('external_ids', {'iface-id': '442e2ec7-1fc5-414a-8dce-4b87e2c201c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:ed:97', 'vm-uuid': 'a54d682f-41ac-4ab4-b622-3659d507016b'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:23 user nova-compute[75235]: INFO os_vif [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f')
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No VIF found with MAC fa:16:3e:a4:ed:97, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:18:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.policy [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c547f019112442b7ac97442ce3432365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b84f68d6c554611a982ef7326409952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:18:23 user nova-compute[75235]: INFO nova.virt.block_device [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Booting with volume-backed-image 2df0cf47-6e1a-495b-92f5-27a94d1b3217 at /dev/vda
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updated VIF entry in instance network info cache for port 442e2ec7-1fc5-414a-8dce-4b87e2c201c8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating instance_info_cache with network_info: [{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-39a59d18-0980-4882-8e96-f69d59f5e7f7 req-9c297da5-7e4c-4928-bd60-203e5c08f9b8 service nova] Releasing lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Successfully created port: 4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-e091220f-4f71-4fc3-bc56-c82944eadec5 req-96671645-58a7-4f91-b279-8f981f6ae6b7 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e091220f-4f71-4fc3-bc56-c82944eadec5 req-96671645-58a7-4f91-b279-8f981f6ae6b7 service nova] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e091220f-4f71-4fc3-bc56-c82944eadec5 req-96671645-58a7-4f91-b279-8f981f6ae6b7 service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e091220f-4f71-4fc3-bc56-c82944eadec5 req-96671645-58a7-4f91-b279-8f981f6ae6b7 service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-e091220f-4f71-4fc3-bc56-c82944eadec5 req-96671645-58a7-4f91-b279-8f981f6ae6b7 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] No waiting events found dispatching network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:24 user nova-compute[75235]: WARNING nova.compute.manager [req-e091220f-4f71-4fc3-bc56-c82944eadec5 req-96671645-58a7-4f91-b279-8f981f6ae6b7 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received unexpected event network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 for instance with vm_state building and task_state spawning.
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Successfully updated port: 4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-changed-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.compute.manager [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Refreshing instance network info cache due to event network-changed-4fa7c083-ab1d-4cea-9491-8a975ac73015. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] Acquiring lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:18:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating instance_info_cache with network_info: [{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance network_info: |[{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] Acquired lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Refreshing network info cache for port 4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updated VIF entry in instance network info cache for port 4fa7c083-ab1d-4cea-9491-8a975ac73015. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating instance_info_cache with network_info: [{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:18:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-535cb536-0732-4280-bfd5-3c6956385478 req-d08ed71f-4e27-4950-8f80-37e81534a6cc service nova] Releasing lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:18:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Instance spawned successfully.
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:26 user nova-compute[75235]: INFO nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:18:26 user nova-compute[75235]: INFO nova.compute.manager [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Took 6.35 seconds to build instance.
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-f791d709-6b30-4302-a9ce-66275c8a91b3 req-60885b43-928b-44fc-8589-1ecf9353945c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f791d709-6b30-4302-a9ce-66275c8a91b3 req-60885b43-928b-44fc-8589-1ecf9353945c service nova] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f791d709-6b30-4302-a9ce-66275c8a91b3 req-60885b43-928b-44fc-8589-1ecf9353945c service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f791d709-6b30-4302-a9ce-66275c8a91b3 req-60885b43-928b-44fc-8589-1ecf9353945c service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-f791d709-6b30-4302-a9ce-66275c8a91b3 req-60885b43-928b-44fc-8589-1ecf9353945c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] No waiting events found dispatching network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:26 user nova-compute[75235]: WARNING nova.compute.manager [req-f791d709-6b30-4302-a9ce-66275c8a91b3 req-60885b43-928b-44fc-8589-1ecf9353945c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received unexpected event network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 for instance with vm_state active and task_state None.
Nov 29 19:18:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-30894c03-e337-434b-9548-9ef7b6dd00fe tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.447s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG os_brick.utils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef7d6f-ca24-415a-95f2-501de9627157]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55813c-d966-4925-9f9d-2645c2313818]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[502734ca-ac91-4b9e-9188-9321572e7237]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934a4a6-96ab-42d0-90c3-fc48affaab91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:18:34 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:18:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[47468982-4f32-4f37-a2f8-775e65295591]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG os_brick.utils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating existing volume attachment record: 8164f465-8e3c-445f-9292-9234df3765ab {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:18:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:18:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Creating image(s)
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Ensure instance console log exists: /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Start _get_guest_xml network_info=[{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8164f465-8e3c-445f-9292-9234df3765ab', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48a36fcc-48c0-4e84-ab7f-26518d4c57ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd399a62f-5fe1-4c94-9fbd-d886263beffb', 'serial': 'd399a62f-5fe1-4c94-9fbd-d886263beffb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:18:42 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:42 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:18:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:18:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:18:42 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c9d4e-7128-4afc-a76e-7b0453a4f599]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:18:42 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e03fd5-c7ce-44e8-b274-969128d2214b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb] added
Nov 29 19:18:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aefcf9-c41c-4d71-839e-9ccc833e9a09]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe9296-4456-4840-817b-5e622150f390]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DAylsugJ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DAylsugJ" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd08fe5-2ab2-49f8-a80b-8a3271cfe72d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DAylsugJ'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3b611-bbbf-4ff4-b867-7523ad7aed68]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763c91c-2355-4da0-8ad0-ff94e745b0ee]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:18:42 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:18:42 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:18:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:18:42 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:18:42 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:18:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0421dcf9-8c27-4088-9caf-1b653821753d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260]
Nov 29 19:18:42 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260] successful.
Nov 29 19:18:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb71b4e-d602-4885-a0e5-fee2294ec17f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:18:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3403246-6725-49b8-98cb-cb77ae545b6e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:18:43 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:18:43 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:18:43 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:18:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:18:43 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:18:43 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:18:43 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:18:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c90d46-8668-4a95-bf1f-baaa406e3b88]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:18:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23165643037313135', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165643037313135', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718067018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718067018',id=37,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-1r4jddyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:23Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=48a36fcc-48c0-4e84-ab7f-26518d4c57ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'pci_devices' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:18:44 user nova-compute[75235]:   <uuid>48a36fcc-48c0-4e84-ab7f-26518d4c57ca</uuid>
Nov 29 19:18:44 user nova-compute[75235]:   <name>instance-00000025</name>
Nov 29 19:18:44 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:18:44 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:18:44 user nova-compute[75235]:   <metadata>
Nov 29 19:18:44 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:18:44 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:18:44 user nova-compute[75235]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1718067018</nova:name>
Nov 29 19:18:44 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:18:42</nova:creationTime>
Nov 29 19:18:44 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:18:44 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:18:44 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:18:44 user nova-compute[75235]:       <nova:owner>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:user uuid="c547f019112442b7ac97442ce3432365">tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member</nova:user>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:project uuid="9b84f68d6c554611a982ef7326409952">tempest-ServerBootFromVolumeStableRescueTest-1553615524</nova:project>
Nov 29 19:18:44 user nova-compute[75235]:       </nova:owner>
Nov 29 19:18:44 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:18:44 user nova-compute[75235]:       <nova:ports>
Nov 29 19:18:44 user nova-compute[75235]:         <nova:port uuid="4fa7c083-ab1d-4cea-9491-8a975ac73015">
Nov 29 19:18:44 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 19:18:44 user nova-compute[75235]:         </nova:port>
Nov 29 19:18:44 user nova-compute[75235]:       </nova:ports>
Nov 29 19:18:44 user nova-compute[75235]:     </nova:instance>
Nov 29 19:18:44 user nova-compute[75235]:   </metadata>
Nov 29 19:18:44 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:18:44 user nova-compute[75235]:     <system>
Nov 29 19:18:44 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:18:44 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:18:44 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:18:44 user nova-compute[75235]:       <entry name="serial">48a36fcc-48c0-4e84-ab7f-26518d4c57ca</entry>
Nov 29 19:18:44 user nova-compute[75235]:       <entry name="uuid">48a36fcc-48c0-4e84-ab7f-26518d4c57ca</entry>
Nov 29 19:18:44 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:18:44 user nova-compute[75235]:     </system>
Nov 29 19:18:44 user nova-compute[75235]:   </sysinfo>
Nov 29 19:18:44 user nova-compute[75235]:   <os>
Nov 29 19:18:44 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:18:44 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:18:44 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:18:44 user nova-compute[75235]:   </os>
Nov 29 19:18:44 user nova-compute[75235]:   <features>
Nov 29 19:18:44 user nova-compute[75235]:     <acpi/>
Nov 29 19:18:44 user nova-compute[75235]:     <apic/>
Nov 29 19:18:44 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:18:44 user nova-compute[75235]:   </features>
Nov 29 19:18:44 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:18:44 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:18:44 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:18:44 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:18:44 user nova-compute[75235]:   </clock>
Nov 29 19:18:44 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:18:44 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:18:44 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:18:44 user nova-compute[75235]:   </cpu>
Nov 29 19:18:44 user nova-compute[75235]:   <devices>
Nov 29 19:18:44 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:18:44 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:18:44 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:18:44 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:18:44 user nova-compute[75235]:       <serial>d399a62f-5fe1-4c94-9fbd-d886263beffb</serial>
Nov 29 19:18:44 user nova-compute[75235]:     </disk>
Nov 29 19:18:44 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:18:44 user nova-compute[75235]:       <mac address="fa:16:3e:b1:b2:ad"/>
Nov 29 19:18:44 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:18:44 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:18:44 user nova-compute[75235]:       <target dev="tap4fa7c083-ab"/>
Nov 29 19:18:44 user nova-compute[75235]:     </interface>
Nov 29 19:18:44 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:18:44 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/console.log" append="off"/>
Nov 29 19:18:44 user nova-compute[75235]:     </serial>
Nov 29 19:18:44 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:18:44 user nova-compute[75235]:     <video>
Nov 29 19:18:44 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:18:44 user nova-compute[75235]:     </video>
Nov 29 19:18:44 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:18:44 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:18:44 user nova-compute[75235]:     </rng>
Nov 29 19:18:44 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:18:44 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:18:44 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:18:44 user nova-compute[75235]:     </memballoon>
Nov 29 19:18:44 user nova-compute[75235]:   </devices>
Nov 29 19:18:44 user nova-compute[75235]: </domain>
Nov 29 19:18:44 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718067018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718067018',id=37,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-1r4jddyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:23Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=48a36fcc-48c0-4e84-ab7f-26518d4c57ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG os_vif [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1caf12c-8016-5f75-ba3d-2666cd548f52', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fa7c083-ab, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fa7c083-ab, col_values=(('qos', UUID('d57ad95c-1bb1-4aaf-9d40-6fb297eef3bd')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fa7c083-ab, col_values=(('external_ids', {'iface-id': '4fa7c083-ab1d-4cea-9491-8a975ac73015', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:b2:ad', 'vm-uuid': '48a36fcc-48c0-4e84-ab7f-26518d4c57ca'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: INFO os_vif [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab')
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No VIF found with MAC fa:16:3e:b1:b2:ad, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-325ea2c2-bd24-4ff7-abf1-8b1e0c32a23a req-c0c20c7f-fdf3-4790-b59f-2612535215a3 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-325ea2c2-bd24-4ff7-abf1-8b1e0c32a23a req-c0c20c7f-fdf3-4790-b59f-2612535215a3 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-325ea2c2-bd24-4ff7-abf1-8b1e0c32a23a req-c0c20c7f-fdf3-4790-b59f-2612535215a3 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-325ea2c2-bd24-4ff7-abf1-8b1e0c32a23a req-c0c20c7f-fdf3-4790-b59f-2612535215a3 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-325ea2c2-bd24-4ff7-abf1-8b1e0c32a23a req-c0c20c7f-fdf3-4790-b59f-2612535215a3 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:45 user nova-compute[75235]: WARNING nova.compute.manager [req-325ea2c2-bd24-4ff7-abf1-8b1e0c32a23a req-c0c20c7f-fdf3-4790-b59f-2612535215a3 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state building and task_state spawning.
Nov 29 19:18:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:18:47 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance spawned successfully.
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-2683167f-fe0b-4ccc-b315-ac7c0e154fc7 req-903b06dd-4069-4610-8ebf-8cf4a1b3e7f0 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2683167f-fe0b-4ccc-b315-ac7c0e154fc7 req-903b06dd-4069-4610-8ebf-8cf4a1b3e7f0 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2683167f-fe0b-4ccc-b315-ac7c0e154fc7 req-903b06dd-4069-4610-8ebf-8cf4a1b3e7f0 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2683167f-fe0b-4ccc-b315-ac7c0e154fc7 req-903b06dd-4069-4610-8ebf-8cf4a1b3e7f0 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-2683167f-fe0b-4ccc-b315-ac7c0e154fc7 req-903b06dd-4069-4610-8ebf-8cf4a1b3e7f0 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:18:47 user nova-compute[75235]: WARNING nova.compute.manager [req-2683167f-fe0b-4ccc-b315-ac7c0e154fc7 req-903b06dd-4069-4610-8ebf-8cf4a1b3e7f0 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state building and task_state spawning.
Nov 29 19:18:47 user nova-compute[75235]: INFO nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 29 19:18:47 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:18:47 user nova-compute[75235]: INFO nova.compute.manager [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Took 25.29 seconds to build instance.
Nov 29 19:18:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b335db1a-af40-4ec9-a800-dc4a85c330c7 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.404s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:18:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:18:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:01 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:19:05 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:19:05 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:19:05 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=24.943782806396484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2270adba-8fe5-4334-83c3-0adf678b22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:19:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:19:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:19:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:19:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [{"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:19:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:19:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:19:13 user nova-compute[75235]: INFO nova.compute.claims [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Claim successful on node user
Nov 29 19:19:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:19:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:19:14 user nova-compute[75235]: INFO nova.virt.block_device [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Booting with volume snapshot 4256d7e8-88e6-4c80-a913-723cbda0ef1a at /dev/vda
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.policy [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20d52323a014526b5ebd121d637f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e15c428b2f43b9a2e5850370c4f938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Successfully created port: a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Successfully updated port: a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "refresh_cache-9daf24ea-1091-4ccb-9b88-066d503a4cca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquired lock "refresh_cache-9daf24ea-1091-4ccb-9b88-066d503a4cca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-changed-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.compute.manager [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Refreshing instance network info cache due to event network-changed-a4f618f1-8030-46b5-b239-47ec41cb44fe. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] Acquiring lock "refresh_cache-9daf24ea-1091-4ccb-9b88-066d503a4cca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Updating instance_info_cache with network_info: [{"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Releasing lock "refresh_cache-9daf24ea-1091-4ccb-9b88-066d503a4cca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Instance network_info: |[{"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] Acquired lock "refresh_cache-9daf24ea-1091-4ccb-9b88-066d503a4cca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:19:15 user nova-compute[75235]: DEBUG nova.network.neutron [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Refreshing network info cache for port a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:19:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Updated VIF entry in instance network info cache for port a4f618f1-8030-46b5-b239-47ec41cb44fe. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:19:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Updating instance_info_cache with network_info: [{"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ee534801-0fcd-4b49-a670-675e90d7dfe0 req-b6c44492-6196-4499-a1d4-c047ca24e25e service nova] Releasing lock "refresh_cache-9daf24ea-1091-4ccb-9b88-066d503a4cca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:19:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG os_brick.utils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[93694b7d-17cf-4484-b131-488c3c550817]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e392aafb-9b17-46fa-821c-ff94c7430b86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa23e259-3919-4c6e-9d86-875947399b6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61ac75-6fcc-4279-961b-f54d89b98aaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:19:20 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c6e30-4023-4fd5-b536-4ac54d4caa9d]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG os_brick.utils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Updating existing volume attachment record: 76f866dc-09c8-4b5d-88c8-14f300ac17dc {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:19:20 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:21 user nova-compute[75235]: INFO nova.compute.manager [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Terminating instance
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5bde2da-3b95-45fe-abff-0370db058efd req-290598f1-9030-4ff7-9da1-88f5188f8928 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-unplugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5bde2da-3b95-45fe-abff-0370db058efd req-290598f1-9030-4ff7-9da1-88f5188f8928 service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5bde2da-3b95-45fe-abff-0370db058efd req-290598f1-9030-4ff7-9da1-88f5188f8928 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5bde2da-3b95-45fe-abff-0370db058efd req-290598f1-9030-4ff7-9da1-88f5188f8928 service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5bde2da-3b95-45fe-abff-0370db058efd req-290598f1-9030-4ff7-9da1-88f5188f8928 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-unplugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5bde2da-3b95-45fe-abff-0370db058efd req-290598f1-9030-4ff7-9da1-88f5188f8928 service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-unplugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Instance destroyed successfully.
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'resources' on Instance uuid a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-268210074',display_name='tempest-ServerActionsTestOtherA-server-268210074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-268210074',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:14:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-7ve0syrm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "5c2159e5-c7e8-46d3-b968-533f0415b437", "address": "fa:16:3e:93:cd:6a", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c2159e5-c7", "ovs_interfaceid": "5c2159e5-c7e8-46d3-b968-533f0415b437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_vif [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c2159e5-c7, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5404e66f-5ee7-466b-9663-3789a8149d9d) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:21 user nova-compute[75235]: INFO os_vif [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:cd:6a,bridge_name='br-int',has_traffic_filtering=True,id=5c2159e5-c7e8-46d3-b968-533f0415b437,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c2159e5-c7')
Nov 29 19:19:21 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUGPzjvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:19:21 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef2785-0c87-48b1-842b-d594fb3dfa02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:19:21 user nova-compute[75235]: No targets found.
Nov 29 19:19:21 user nova-compute[75235]: iSNS:
Nov 29 19:19:21 user nova-compute[75235]: No targets found.
Nov 29 19:19:21 user nova-compute[75235]: STATIC:
Nov 29 19:19:21 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:19:21 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:19:21 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:19:21 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954
Nov 29 19:19:21 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:19:21 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:19:21 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:19:21 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:19:21 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:19:21 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06
Nov 29 19:19:21 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:19:21 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:19:21 user nova-compute[75235]: FIRMWARE:
Nov 29 19:19:21 user nova-compute[75235]: No targets found.
Nov 29 19:19:21 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:19:21 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:19:21 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cc94c4-ca85-4ed4-aaaf-8a888e6d7462]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[decfc139-3526-4472-977e-00e278450531]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:19:21 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:19:21 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:19:21 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:19:21 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:19:21 user nova-compute[75235]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 (non-flash)
Nov 29 19:19:21 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:19:21 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:19:21 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5659489090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[58396223-38b7-447b-8a95-206e74627f06]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[daec53a7-f4b9-45ca-9683-4a6219eca38f]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[038fcbf5-8311-4cd1-8d88-7c3dea8a9bca]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5edf6ae-fb4d-40cc-9743-75740a8a7ae0]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23461393539383161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_689553bb', '/dev/disk/by-id/scsi-1SCST_BIO689553bb-4a95981aa1f549fa') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f53cf5-b00c-47bd-9637-b61f26cfe44f]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.122s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[02796186-8882-44ad-81ca-cac76c6eebc2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c98cee0-3843-4afc-82de-4309ce656d30]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260]
Nov 29 19:19:22 user nova-compute[75235]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06, portal: 172.16.0.220,3260] successful.
Nov 29 19:19:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc4a9f-18cd-412a-8159-34e3ac12b1c7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] <== disconnect_volume: return (444ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:19:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Deleting instance files /opt/stack/data/nova/instances/a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487_del
Nov 29 19:19:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Deletion of /opt/stack/data/nova/instances/a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487_del complete
Nov 29 19:19:22 user nova-compute[75235]: INFO nova.compute.manager [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 29 19:19:22 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:19:22 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-55237dc0-b837-4622-a446-cdd71ecec7a4 req-6e10048c-24ce-483e-a6b3-e8fff766f50f service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-deleted-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:23 user nova-compute[75235]: INFO nova.compute.manager [req-55237dc0-b837-4622-a446-cdd71ecec7a4 req-6e10048c-24ce-483e-a6b3-e8fff766f50f service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Neutron deleted interface 5c2159e5-c7e8-46d3-b968-533f0415b437; detaching it from the instance and deleting it from the info cache
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-55237dc0-b837-4622-a446-cdd71ecec7a4 req-6e10048c-24ce-483e-a6b3-e8fff766f50f service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:23 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Took 0.63 seconds to deallocate network for instance.
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-55237dc0-b837-4622-a446-cdd71ecec7a4 req-6e10048c-24ce-483e-a6b3-e8fff766f50f service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Detach interface failed, port_id=5c2159e5-c7e8-46d3-b968-533f0415b437, reason: Instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-9b1cfd71-a839-4c2a-af6c-bb514bccb461 req-9f939e06-7de1-4202-a8b3-9f7675ed9ffa service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9b1cfd71-a839-4c2a-af6c-bb514bccb461 req-9f939e06-7de1-4202-a8b3-9f7675ed9ffa service nova] Acquiring lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9b1cfd71-a839-4c2a-af6c-bb514bccb461 req-9f939e06-7de1-4202-a8b3-9f7675ed9ffa service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9b1cfd71-a839-4c2a-af6c-bb514bccb461 req-9f939e06-7de1-4202-a8b3-9f7675ed9ffa service nova] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-9b1cfd71-a839-4c2a-af6c-bb514bccb461 req-9f939e06-7de1-4202-a8b3-9f7675ed9ffa service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] No waiting events found dispatching network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:19:23 user nova-compute[75235]: WARNING nova.compute.manager [req-9b1cfd71-a839-4c2a-af6c-bb514bccb461 req-9f939e06-7de1-4202-a8b3-9f7675ed9ffa service nova] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Received unexpected event network-vif-plugged-5c2159e5-c7e8-46d3-b968-533f0415b437 for instance with vm_state active and task_state deleting.
Nov 29 19:19:23 user nova-compute[75235]: INFO nova.compute.manager [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Took 0.89 seconds to detach 1 volumes for instance.
Nov 29 19:19:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487] Deleting volume: 2f19bd84-5ddf-4b43-bc69-ea4c56d21d06 {{(pid=75235) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 19:19:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:24 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:19:24 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:19:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:24 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Deleted allocations for instance a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487
Nov 29 19:19:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2d24b798-41be-4053-89b4-ba01bf3fddb4 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "a3d598bf-7f90-4fc8-97a7-e8d5d4e4b487" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.595s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:19:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Creating image(s)
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Ensure instance console log exists: /opt/stack/data/nova/instances/9daf24ea-1091-4ccb-9b88-066d503a4cca/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Start _get_guest_xml network_info=[{"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '76f866dc-09c8-4b5d-88c8-14f300ac17dc', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJqMsadi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9daf24ea-1091-4ccb-9b88-066d503a4cca', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a', 'serial': 'c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:19:28 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:19:28 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJqMsadi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:19:28 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:19:28 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:19:28 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5cd019-f696-4c9d-af94-848128d21c8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:19:28 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b801ba5-3607-4f03-a535-f6c22bbf33aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a] added
Nov 29 19:19:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dfe734-8b17-4aa3-b70c-1f3ad18ccb22]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8aaa85-7067-4700-9774-695c1f1ca9a2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJqMsadi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SJqMsadi" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f47791-8c29-4919-ae76-da8810eb5438]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SJqMsadi'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2be307-c669-4113-8b8d-7b9001019c5d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7bad7b-4905-4f87-99a0-0dea2b7012e5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:19:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:19:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e77de-7eb9-4b3f-8394-20f5b272afbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260]
Nov 29 19:19:28 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260] successful.
Nov 29 19:19:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6671fdd2-5029-4cd3-b4ba-21e41036cb8a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda9c399-0b2b-4329-91b3-ad736f3108c0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:19:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:19:28 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:19:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[824da6f8-16f5-476f-a8d7-4ce04bdb1a69]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:19:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJqMsadi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26139363732336535', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139363732336535', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:19:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618176960',display_name='tempest-TestVolumeBootPattern-server-1618176960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618176960',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-or7koc5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:19:14Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=9daf24ea-1091-4ccb-9b88-066d503a4cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'pci_devices' on Instance uuid 9daf24ea-1091-4ccb-9b88-066d503a4cca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:19:29 user nova-compute[75235]:   <uuid>9daf24ea-1091-4ccb-9b88-066d503a4cca</uuid>
Nov 29 19:19:29 user nova-compute[75235]:   <name>instance-00000026</name>
Nov 29 19:19:29 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:19:29 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:19:29 user nova-compute[75235]:   <metadata>
Nov 29 19:19:29 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:19:29 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:19:29 user nova-compute[75235]:       <nova:name>tempest-TestVolumeBootPattern-server-1618176960</nova:name>
Nov 29 19:19:29 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:19:28</nova:creationTime>
Nov 29 19:19:29 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:19:29 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:19:29 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:19:29 user nova-compute[75235]:       <nova:owner>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:user uuid="f20d52323a014526b5ebd121d637f4c4">tempest-TestVolumeBootPattern-656128499-project-member</nova:user>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:project uuid="87e15c428b2f43b9a2e5850370c4f938">tempest-TestVolumeBootPattern-656128499</nova:project>
Nov 29 19:19:29 user nova-compute[75235]:       </nova:owner>
Nov 29 19:19:29 user nova-compute[75235]:       <nova:ports>
Nov 29 19:19:29 user nova-compute[75235]:         <nova:port uuid="a4f618f1-8030-46b5-b239-47ec41cb44fe">
Nov 29 19:19:29 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 19:19:29 user nova-compute[75235]:         </nova:port>
Nov 29 19:19:29 user nova-compute[75235]:       </nova:ports>
Nov 29 19:19:29 user nova-compute[75235]:     </nova:instance>
Nov 29 19:19:29 user nova-compute[75235]:   </metadata>
Nov 29 19:19:29 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:19:29 user nova-compute[75235]:     <system>
Nov 29 19:19:29 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:19:29 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:19:29 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:19:29 user nova-compute[75235]:       <entry name="serial">9daf24ea-1091-4ccb-9b88-066d503a4cca</entry>
Nov 29 19:19:29 user nova-compute[75235]:       <entry name="uuid">9daf24ea-1091-4ccb-9b88-066d503a4cca</entry>
Nov 29 19:19:29 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:19:29 user nova-compute[75235]:     </system>
Nov 29 19:19:29 user nova-compute[75235]:   </sysinfo>
Nov 29 19:19:29 user nova-compute[75235]:   <os>
Nov 29 19:19:29 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:19:29 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:19:29 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:19:29 user nova-compute[75235]:   </os>
Nov 29 19:19:29 user nova-compute[75235]:   <features>
Nov 29 19:19:29 user nova-compute[75235]:     <acpi/>
Nov 29 19:19:29 user nova-compute[75235]:     <apic/>
Nov 29 19:19:29 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:19:29 user nova-compute[75235]:   </features>
Nov 29 19:19:29 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:19:29 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:19:29 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:19:29 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:19:29 user nova-compute[75235]:   </clock>
Nov 29 19:19:29 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:19:29 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:19:29 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:19:29 user nova-compute[75235]:   </cpu>
Nov 29 19:19:29 user nova-compute[75235]:   <devices>
Nov 29 19:19:29 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:19:29 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:19:29 user nova-compute[75235]:       <source dev="/dev/sdc"/>
Nov 29 19:19:29 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:19:29 user nova-compute[75235]:       <serial>c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a</serial>
Nov 29 19:19:29 user nova-compute[75235]:     </disk>
Nov 29 19:19:29 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:19:29 user nova-compute[75235]:       <mac address="fa:16:3e:58:eb:33"/>
Nov 29 19:19:29 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:19:29 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:19:29 user nova-compute[75235]:       <target dev="tapa4f618f1-80"/>
Nov 29 19:19:29 user nova-compute[75235]:     </interface>
Nov 29 19:19:29 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:19:29 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/9daf24ea-1091-4ccb-9b88-066d503a4cca/console.log" append="off"/>
Nov 29 19:19:29 user nova-compute[75235]:     </serial>
Nov 29 19:19:29 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:19:29 user nova-compute[75235]:     <video>
Nov 29 19:19:29 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:19:29 user nova-compute[75235]:     </video>
Nov 29 19:19:29 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:19:29 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:19:29 user nova-compute[75235]:     </rng>
Nov 29 19:19:29 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:19:29 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:19:29 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:19:29 user nova-compute[75235]:     </memballoon>
Nov 29 19:19:29 user nova-compute[75235]:   </devices>
Nov 29 19:19:29 user nova-compute[75235]: </domain>
Nov 29 19:19:29 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:19:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618176960',display_name='tempest-TestVolumeBootPattern-server-1618176960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618176960',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-or7koc5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:19:14Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=9daf24ea-1091-4ccb-9b88-066d503a4cca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG os_vif [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd23bc94f-3d45-5d7f-88f5-901454e7d2e0', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4f618f1-80, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4f618f1-80, col_values=(('qos', UUID('8e3cb625-9913-4c65-ae0c-f3ec6db065b4')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4f618f1-80, col_values=(('external_ids', {'iface-id': 'a4f618f1-8030-46b5-b239-47ec41cb44fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:eb:33', 'vm-uuid': '9daf24ea-1091-4ccb-9b88-066d503a4cca'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:29 user nova-compute[75235]: INFO os_vif [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80')
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:19:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No VIF found with MAC fa:16:3e:58:eb:33, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-7bcf859d-ab09-443c-8dc2-b12f81952836 req-08fcb6a5-1277-485b-8bdb-66be752f1792 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7bcf859d-ab09-443c-8dc2-b12f81952836 req-08fcb6a5-1277-485b-8bdb-66be752f1792 service nova] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7bcf859d-ab09-443c-8dc2-b12f81952836 req-08fcb6a5-1277-485b-8bdb-66be752f1792 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7bcf859d-ab09-443c-8dc2-b12f81952836 req-08fcb6a5-1277-485b-8bdb-66be752f1792 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-7bcf859d-ab09-443c-8dc2-b12f81952836 req-08fcb6a5-1277-485b-8bdb-66be752f1792 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] No waiting events found dispatching network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:19:31 user nova-compute[75235]: WARNING nova.compute.manager [req-7bcf859d-ab09-443c-8dc2-b12f81952836 req-08fcb6a5-1277-485b-8bdb-66be752f1792 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received unexpected event network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe for instance with vm_state building and task_state spawning.
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:19:33 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Instance spawned successfully.
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:19:33 user nova-compute[75235]: INFO nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-f359456d-f37d-4a1f-b55d-eb09245f032c req-e412cb51-49da-43a1-b670-dbc6280a3e23 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f359456d-f37d-4a1f-b55d-eb09245f032c req-e412cb51-49da-43a1-b670-dbc6280a3e23 service nova] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f359456d-f37d-4a1f-b55d-eb09245f032c req-e412cb51-49da-43a1-b670-dbc6280a3e23 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f359456d-f37d-4a1f-b55d-eb09245f032c req-e412cb51-49da-43a1-b670-dbc6280a3e23 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-f359456d-f37d-4a1f-b55d-eb09245f032c req-e412cb51-49da-43a1-b670-dbc6280a3e23 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] No waiting events found dispatching network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:19:33 user nova-compute[75235]: WARNING nova.compute.manager [req-f359456d-f37d-4a1f-b55d-eb09245f032c req-e412cb51-49da-43a1-b670-dbc6280a3e23 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received unexpected event network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe for instance with vm_state building and task_state spawning.
Nov 29 19:19:33 user nova-compute[75235]: INFO nova.compute.manager [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Took 19.80 seconds to build instance.
Nov 29 19:19:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1f40e720-c9aa-41b1-a765-fbaeef65a200 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.894s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:19:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:19:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:19:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:19:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:19:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing instance network info cache due to event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG nova.network.neutron [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updated VIF entry in instance network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1e7078ae-b9db-4732-82c3-6fb0728dfed4 req-26fb4493-3990-4dc3-abfb-cb48260acae0 service nova] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing instance network info cache due to event network-changed-6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] Acquiring lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] Acquired lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Refreshing network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:50 user nova-compute[75235]: INFO nova.compute.manager [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Detaching volume 9bcbbe88-6093-4d35-948e-4996962b0954
Nov 29 19:19:51 user nova-compute[75235]: INFO nova.virt.block_device [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Attempting to driver detach volume 9bcbbe88-6093-4d35-948e-4996962b0954 from mountpoint /dev/vdb
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Attempting to detach device vdb from instance 2270adba-8fe5-4334-83c3-0adf678b22fd from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:19:51 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:19:51 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:19:51 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:19:51 user nova-compute[75235]:   <serial>9bcbbe88-6093-4d35-948e-4996962b0954</serial>
Nov 29 19:19:51 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:19:51 user nova-compute[75235]: </disk>
Nov 29 19:19:51 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:19:51 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully detached device vdb from instance 2270adba-8fe5-4334-83c3-0adf678b22fd from the persistent domain config.
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2270adba-8fe5-4334-83c3-0adf678b22fd from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:19:51 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:19:51 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:19:51 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:19:51 user nova-compute[75235]:   <serial>9bcbbe88-6093-4d35-948e-4996962b0954</serial>
Nov 29 19:19:51 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:19:51 user nova-compute[75235]: </disk>
Nov 29 19:19:51 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.network.neutron [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updated VIF entry in instance network info cache for port 6b034b10-f86b-4912-a6df-b9c5334a816c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.network.neutron [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [{"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4eab34c4-aeb6-49a1-ab3b-7bb5103a7caa req-6451a4ee-4fbd-4ed7-833b-4e93e829c6e1 service nova] Releasing lock "refresh_cache-2270adba-8fe5-4334-83c3-0adf678b22fd" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:19:51 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:19:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing instance network info cache due to event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'flavor' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:19:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updated VIF entry in instance network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG nova.network.neutron [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:19:58 user nova-compute[75235]: INFO nova.compute.manager [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Attaching volume 99d16c9b-0e54-4707-a019-c87264a21e47 to /dev/vdb
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-22528dec-9983-415b-a37b-232b23ab2ae3 req-27d63b3b-9464-4c17-8e21-8da9789b793f service nova] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG os_brick.utils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab19529-2b43-4c59-a21b-806dd438fc26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be6edc3-b305-4f6b-bf18-eac4a3c60300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c22d38-e060-49cc-87a9-bf8525da7730]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b92bfb-aac1-4b81-9d0a-cdad834f498f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:19:58 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:19:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6e9a0d-9fef-4608-9ac6-2bd60ff62e8c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG os_brick.utils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:19:58 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating existing volume attachment record: 4df124d1-a1f1-4c8f-b295-d612d4fa1516 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:19:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:19:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGmPIFnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:20:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:05 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb7548-ce99-457f-977b-3714c206e043]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:20:05 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7514c8d-6eff-4b4c-8e53-25e2a1a77289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47] added
Nov 29 19:20:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f1f1f-bb93-45d6-8ece-4921db524611]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[92614f9f-8acc-42bf-83ad-11e1a0ab0c89]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGmPIFnr {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGmPIFnr" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3127e234-a283-471c-898b-25977e4b614a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KGmPIFnr'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f603fe-a1cb-4717-8890-6f509240473f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1cd6b2-836b-4c39-9338-9a93203b1f18]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:20:06 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=24.94097900390625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5da445-3d8a-4315-94cf-7b7e55e7266f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260]
Nov 29 19:20:06 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260] successful.
Nov 29 19:20:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78231f5-4633-4420-99ae-24cbe052b9b7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209ccba-9f63-4679-a4aa-a2e1a4de3822]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:06 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:06 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.731s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf2629f-00d2-4cbb-b663-fcfd714be2a0]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGmPIFnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c1d8be89-d905-43dc-8d73-4632fa1e7227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2270adba-8fe5-4334-83c3-0adf678b22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9daf24ea-1091-4ccb-9b88-066d503a4cca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:20:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.767s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] <== connect_volume: return (1768ms) {'type': 'block', 'scsi_wwn': '23163386138663738', 'path': '/dev/sdf'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163386138663738', 'path': '/dev/sdf'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'flavor' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:20:07 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:20:07 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:20:07 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:20:07 user nova-compute[75235]:   <serial>99d16c9b-0e54-4707-a019-c87264a21e47</serial>
Nov 29 19:20:07 user nova-compute[75235]: </disk>
Nov 29 19:20:07 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:b5:d3:6c, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ea261d35-e1e6-47f4-b5ee-62482781531e tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.233s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:20:09 user nova-compute[75235]: INFO nova.compute.manager [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Rescuing
Nov 29 19:20:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-9742b726-50d1-4a1d-b977-d069b26e6ab1 req-a1a1ecbc-2f6f-4d8b-b96f-b54d95f6bd78 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9742b726-50d1-4a1d-b977-d069b26e6ab1 req-a1a1ecbc-2f6f-4d8b-b96f-b54d95f6bd78 service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9742b726-50d1-4a1d-b977-d069b26e6ab1 req-a1a1ecbc-2f6f-4d8b-b96f-b54d95f6bd78 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9742b726-50d1-4a1d-b977-d069b26e6ab1 req-a1a1ecbc-2f6f-4d8b-b96f-b54d95f6bd78 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-9742b726-50d1-4a1d-b977-d069b26e6ab1 req-a1a1ecbc-2f6f-4d8b-b96f-b54d95f6bd78 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:10 user nova-compute[75235]: WARNING nova.compute.manager [req-9742b726-50d1-4a1d-b977-d069b26e6ab1 req-a1a1ecbc-2f6f-4d8b-b96f-b54d95f6bd78 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state active and task_state rescuing.
Nov 29 19:20:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance destroyed successfully.
Nov 29 19:20:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Attempting rescue
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75235) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:20:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Creating image(s)
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue" returned: 0 in 0.051s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'migration_context' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<87f07af2-b1c8-47cd-be42-786dd4ee8f2c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Start _get_guest_xml network_info=[{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:b5:d3:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'resources' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<87f07af2-b1c8-47cd-be42-786dd4ee8f2c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'numa_topology' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<87f07af2-b1c8-47cd-be42-786dd4ee8f2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:20:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<87f07af2-b1c8-47cd-be42-786dd4ee8f2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-882513022',display_name='tempest-ServerRescueNegativeTestJSON-server-882513022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-882513022',id=35,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL4pdw6IxotoOWuh3YJnAWGaYdR2hnd7TFyyshEjvsUyltlIzZHO7qD0suc5S1bneaKKS89VqCKW2RuVN5J6i2ZkaTDeUvb7RLp5hgvfOGmV5Og0dGHAi8IamaCRLJ12Q==',key_name='tempest-keypair-1426874437',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-6qa0hs2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b09701817c0147aca7432e1329b82300',uuid=87f07af2-b1c8-47cd-be42-786dd4ee8f2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:b5:d3:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "vif_mac": "fa:16:3e:b5:d3:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.instance [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.objects.base [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Object Instance<87f07af2-b1c8-47cd-be42-786dd4ee8f2c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:20:10 user nova-compute[75235]:   <uuid>87f07af2-b1c8-47cd-be42-786dd4ee8f2c</uuid>
Nov 29 19:20:10 user nova-compute[75235]:   <name>instance-00000023</name>
Nov 29 19:20:10 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:20:10 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:20:10 user nova-compute[75235]:   <metadata>
Nov 29 19:20:10 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:20:10 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:20:10 user nova-compute[75235]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-882513022</nova:name>
Nov 29 19:20:10 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:20:10</nova:creationTime>
Nov 29 19:20:10 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:20:10 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:20:10 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:20:10 user nova-compute[75235]:       <nova:owner>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:user uuid="b09701817c0147aca7432e1329b82300">tempest-ServerRescueNegativeTestJSON-1726326315-project-member</nova:user>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:project uuid="a77e6e9f44ec4c76b5c8f8f29c7e651f">tempest-ServerRescueNegativeTestJSON-1726326315</nova:project>
Nov 29 19:20:10 user nova-compute[75235]:       </nova:owner>
Nov 29 19:20:10 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:20:10 user nova-compute[75235]:       <nova:ports>
Nov 29 19:20:10 user nova-compute[75235]:         <nova:port uuid="51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c">
Nov 29 19:20:10 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 19:20:10 user nova-compute[75235]:         </nova:port>
Nov 29 19:20:10 user nova-compute[75235]:       </nova:ports>
Nov 29 19:20:10 user nova-compute[75235]:     </nova:instance>
Nov 29 19:20:10 user nova-compute[75235]:   </metadata>
Nov 29 19:20:10 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:20:10 user nova-compute[75235]:     <system>
Nov 29 19:20:10 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:20:10 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:20:10 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:20:10 user nova-compute[75235]:       <entry name="serial">87f07af2-b1c8-47cd-be42-786dd4ee8f2c</entry>
Nov 29 19:20:10 user nova-compute[75235]:       <entry name="uuid">87f07af2-b1c8-47cd-be42-786dd4ee8f2c</entry>
Nov 29 19:20:10 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:20:10 user nova-compute[75235]:     </system>
Nov 29 19:20:10 user nova-compute[75235]:   </sysinfo>
Nov 29 19:20:10 user nova-compute[75235]:   <os>
Nov 29 19:20:10 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:20:10 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:20:10 user nova-compute[75235]:   </os>
Nov 29 19:20:10 user nova-compute[75235]:   <features>
Nov 29 19:20:10 user nova-compute[75235]:     <acpi/>
Nov 29 19:20:10 user nova-compute[75235]:     <apic/>
Nov 29 19:20:10 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:20:10 user nova-compute[75235]:   </features>
Nov 29 19:20:10 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:20:10 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:20:10 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:20:10 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:20:10 user nova-compute[75235]:   </clock>
Nov 29 19:20:10 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:20:10 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:20:10 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:20:10 user nova-compute[75235]:   </cpu>
Nov 29 19:20:10 user nova-compute[75235]:   <devices>
Nov 29 19:20:10 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:20:10 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:20:10 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue"/>
Nov 29 19:20:10 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:20:10 user nova-compute[75235]:     </disk>
Nov 29 19:20:10 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:20:10 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:20:10 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk"/>
Nov 29 19:20:10 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:20:10 user nova-compute[75235]:     </disk>
Nov 29 19:20:10 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:20:10 user nova-compute[75235]:       <mac address="fa:16:3e:b5:d3:6c"/>
Nov 29 19:20:10 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:20:10 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:20:10 user nova-compute[75235]:       <target dev="tap51fc0d05-ce"/>
Nov 29 19:20:10 user nova-compute[75235]:     </interface>
Nov 29 19:20:10 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:20:10 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/console.log" append="off"/>
Nov 29 19:20:10 user nova-compute[75235]:     </serial>
Nov 29 19:20:10 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:20:10 user nova-compute[75235]:     <video>
Nov 29 19:20:10 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:20:10 user nova-compute[75235]:     </video>
Nov 29 19:20:10 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:20:10 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:20:10 user nova-compute[75235]:     </rng>
Nov 29 19:20:10 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:20:10 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:20:10 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:20:10 user nova-compute[75235]:     </memballoon>
Nov 29 19:20:10 user nova-compute[75235]:   </devices>
Nov 29 19:20:10 user nova-compute[75235]: </domain>
Nov 29 19:20:10 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:20:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance destroyed successfully.
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] No VIF found with MAC fa:16:3e:b5:d3:6c, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:20:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2270adba-8fe5-4334-83c3-0adf678b22fd is timed out.
Nov 29 19:20:11 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully detached device vdb from instance 2270adba-8fe5-4334-83c3-0adf678b22fd from the live domain config.
Nov 29 19:20:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxFuYXBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:20:11 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[25196764-7bb9-4a28-9a87-1cbd8f6abeda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:20:11 user nova-compute[75235]: No targets found.
Nov 29 19:20:11 user nova-compute[75235]: iSNS:
Nov 29 19:20:11 user nova-compute[75235]: No targets found.
Nov 29 19:20:11 user nova-compute[75235]: STATIC:
Nov 29 19:20:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:20:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:20:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a
Nov 29 19:20:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954
Nov 29 19:20:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:11 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:20:11 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:11 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:11 user nova-compute[75235]: FIRMWARE:
Nov 29 19:20:11 user nova-compute[75235]: No targets found.
Nov 29 19:20:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:20:11 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:20:11 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b04d88-baa7-4a33-a3a1-263b62ff87f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[32486587-6bdd-4a2a-85ae-4e7aaaf18122]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:11 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c5c4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842851f-7adf-4c99-960f-7b6effa20965]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[60378a4b-2046-4233-afab-fd63c17737ec]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1286f907-32c2-4ae3-8596-802d12618108]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[021780bb-2535-46ad-8452-6f0d127aa466]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b61b945-1efe-4d30-83bc-b0c6ade2b1f0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d1f84-6ab0-4a1f-a954-04fa99b6506d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260]
Nov 29 19:20:11 user nova-compute[75235]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954, portal: 172.16.0.220,3260] successful.
Nov 29 19:20:11 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bcbbe88-6093-4d35-948e-4996962b0954 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e4a6d6-1408-4939-98ce-d4827ebe081e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] <== disconnect_volume: return (341ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:20:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-ccf60cfb-47c8-4a6a-a3fa-e940dc916c80 req-939eac51-3c81-4966-96d8-b8ace858afbb service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ccf60cfb-47c8-4a6a-a3fa-e940dc916c80 req-939eac51-3c81-4966-96d8-b8ace858afbb service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ccf60cfb-47c8-4a6a-a3fa-e940dc916c80 req-939eac51-3c81-4966-96d8-b8ace858afbb service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ccf60cfb-47c8-4a6a-a3fa-e940dc916c80 req-939eac51-3c81-4966-96d8-b8ace858afbb service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-ccf60cfb-47c8-4a6a-a3fa-e940dc916c80 req-939eac51-3c81-4966-96d8-b8ace858afbb service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:12 user nova-compute[75235]: WARNING nova.compute.manager [req-ccf60cfb-47c8-4a6a-a3fa-e940dc916c80 req-939eac51-3c81-4966-96d8-b8ace858afbb service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state active and task_state rescuing.
Nov 29 19:20:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-changed-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Refreshing instance network info cache due to event network-changed-442e2ec7-1fc5-414a-8dce-4b87e2c201c8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] Acquiring lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] Acquired lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG nova.network.neutron [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Refreshing network info cache for port 442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG nova.objects.instance [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'flavor' on Instance uuid 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b217b84e-90b5-4696-b6b6-2febdd76484f tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.918s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:13 user nova-compute[75235]: INFO nova.compute.manager [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Rescuing
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG nova.network.neutron [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updated VIF entry in instance network info cache for port 442e2ec7-1fc5-414a-8dce-4b87e2c201c8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG nova.network.neutron [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating instance_info_cache with network_info: [{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c2190c5-a349-4c17-b47e-6173b444cb84 req-3a41aecd-3cb4-4c14-909c-6c45e7520235 service nova] Releasing lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'flavor' on Instance uuid a54d682f-41ac-4ab4-b622-3659d507016b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating instance_info_cache with network_info: [{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:14 user nova-compute[75235]: INFO nova.compute.manager [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Attaching volume 6292c455-e785-424a-83cf-41c98e27b3b1 to /dev/vdb
Nov 29 19:20:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:14 user nova-compute[75235]: WARNING nova.compute.manager [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state active and task_state rescuing.
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:14 user nova-compute[75235]: WARNING nova.compute.manager [req-04851545-913e-4ea9-9745-f262366a498b req-c7d5246d-72f3-4a0c-875b-49f6d03b3b82 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state active and task_state rescuing.
Nov 29 19:20:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG os_brick.utils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2add93b6-f81f-491d-b0e6-dd2a0eccc094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7445fa-9b26-490b-9a89-521ebff33cb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dfb13c-c50c-4c30-a4b5-fdd3d636920b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d41c7-5458-42ab-b333-9d5d7b4b04e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:20:14 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff81fd85-3034-45dc-913b-276e980a8702]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG os_brick.utils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating existing volume attachment record: 0d78a786-5c64-4eab-ad90-ea1af4cf3584 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8edce174-6460-489a-9b46-923392b029ef req-73d1ecb7-aa45-4160-93b1-4fe3776b0894 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8edce174-6460-489a-9b46-923392b029ef req-73d1ecb7-aa45-4160-93b1-4fe3776b0894 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8edce174-6460-489a-9b46-923392b029ef req-73d1ecb7-aa45-4160-93b1-4fe3776b0894 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8edce174-6460-489a-9b46-923392b029ef req-73d1ecb7-aa45-4160-93b1-4fe3776b0894 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-8edce174-6460-489a-9b46-923392b029ef req-73d1ecb7-aa45-4160-93b1-4fe3776b0894 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:14 user nova-compute[75235]: WARNING nova.compute.manager [req-8edce174-6460-489a-9b46-923392b029ef req-73d1ecb7-aa45-4160-93b1-4fe3776b0894 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state active and task_state rescuing.
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-56ba1751-7c78-4be0-b228-9b790ab061b2 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance destroyed successfully.
Nov 29 19:20:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Attempting a stable device rescue
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75235) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance directory exists: not creating {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 19:20:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Creating image(s)
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "/opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "/opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "78f97d2a18946cdb7ead3aae63c34d0a90aa7a20" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "78f97d2a18946cdb7ead3aae63c34d0a90aa7a20" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG nova.virt.images [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] 33fe4fd7-f314-4ceb-b45b-03541a7164ea was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.part /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-c262a309-eaa5-41c9-9258-394be29d19ed req-e74fff94-3859-4b43-ac53-71dab3b10017 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c262a309-eaa5-41c9-9258-394be29d19ed req-e74fff94-3859-4b43-ac53-71dab3b10017 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c262a309-eaa5-41c9-9258-394be29d19ed req-e74fff94-3859-4b43-ac53-71dab3b10017 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c262a309-eaa5-41c9-9258-394be29d19ed req-e74fff94-3859-4b43-ac53-71dab3b10017 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-c262a309-eaa5-41c9-9258-394be29d19ed req-e74fff94-3859-4b43-ac53-71dab3b10017 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:16 user nova-compute[75235]: WARNING nova.compute.manager [req-c262a309-eaa5-41c9-9258-394be29d19ed req-e74fff94-3859-4b43-ac53-71dab3b10017 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state active and task_state rescuing.
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.part /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.converted" returned: 0 in 0.674s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20.converted --force-share --output=json" returned: 0 in 0.298s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "78f97d2a18946cdb7ead3aae63c34d0a90aa7a20" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.216s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "78f97d2a18946cdb7ead3aae63c34d0a90aa7a20" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "78f97d2a18946cdb7ead3aae63c34d0a90aa7a20" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:17 user nova-compute[75235]: INFO nova.compute.manager [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Terminating instance
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20 --force-share --output=json" returned: 0 in 0.270s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20,backing_fmt=raw /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20,backing_fmt=raw /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue" returned: 0 in 0.059s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "78f97d2a18946cdb7ead3aae63c34d0a90aa7a20" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'migration_context' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<48a36fcc-48c0-4e84-ab7f-26518d4c57ca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Start _get_guest_xml network_info=[{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "vif_mac": "fa:16:3e:b1:b2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '33fe4fd7-f314-4ceb-b45b-03541a7164ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8164f465-8e3c-445f-9292-9234df3765ab', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '48a36fcc-48c0-4e84-ab7f-26518d4c57ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd399a62f-5fe1-4c94-9fbd-d886263beffb', 'serial': 'd399a62f-5fe1-4c94-9fbd-d886263beffb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'resources' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<48a36fcc-48c0-4e84-ab7f-26518d4c57ca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'numa_topology' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<48a36fcc-48c0-4e84-ab7f-26518d4c57ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:17 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:20:17 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<48a36fcc-48c0-4e84-ab7f-26518d4c57ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:20:17 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:17 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:17 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45ff71-f688-42e0-af64-1415e0321bfe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DAylsugJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 19:20:17 user nova-compute[75235]: node.name = iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:20:17 user nova-compute[75235]: node.tpgt = -1
Nov 29 19:20:17 user nova-compute[75235]: node.startup = automatic
Nov 29 19:20:17 user nova-compute[75235]: node.leading_login = No
Nov 29 19:20:17 user nova-compute[75235]: iface.iscsi_ifacename = default
Nov 29 19:20:17 user nova-compute[75235]: iface.net_ifacename = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.ipaddress = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.prefix_len = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.hwaddress = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.transport_name = tcp
Nov 29 19:20:17 user nova-compute[75235]: iface.initiatorname = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.vlan_id = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.vlan_priority = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.vlan_state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.iface_num = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.mtu = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.port = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.bootproto = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.subnet_mask = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.gateway = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_alt_client_id = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_dns = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_learn_iqn = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_vendor_id_state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_vendor_id = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.dhcp_slp_da = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.fragmentation = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.gratuitous_arp = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.incoming_forwarding = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.tos_state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.tos = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.ttl = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.delayed_ack = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.tcp_nagle = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.tcp_wsf_state = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.tcp_wsf = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.tcp_timer_scale = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.tcp_timestamp = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.redirect = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.def_task_mgmt_timeout = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.header_digest = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.data_digest = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.immediate_data = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.initial_r2t = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.data_seq_inorder = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.data_pdu_inorder = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.erl = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.max_receive_data_len = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.first_burst_len = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.max_outstanding_r2t = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.max_burst_len = 0
Nov 29 19:20:17 user nova-compute[75235]: iface.chap_auth = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.bidi_chap = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.strict_login_compliance = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.discovery_auth = <empty>
Nov 29 19:20:17 user nova-compute[75235]: iface.discovery_logout = <empty>
Nov 29 19:20:17 user nova-compute[75235]: node.discovery_address = <empty>
Nov 29 19:20:17 user nova-compute[75235]: node.discovery_port = 0
Nov 29 19:20:17 user nova-compute[75235]: node.discovery_type = static
Nov 29 19:20:17 user nova-compute[75235]: node.session.initial_cmdsn = 0
Nov 29 19:20:17 user nova-compute[75235]: node.session.initial_login_retry_max = 8
Nov 29 19:20:17 user nova-compute[75235]: node.session.xmit_thread_priority = -20
Nov 29 19:20:17 user nova-compute[75235]: node.session.cmds_max = 128
Nov 29 19:20:17 user nova-compute[75235]: node.session.queue_depth = 32
Nov 29 19:20:17 user nova-compute[75235]: node.session.nr_sessions = 1
Nov 29 19:20:17 user nova-compute[75235]: node.session.auth.authmethod = CHAP
Nov 29 19:20:17 user nova-compute[75235]: node.session.auth.username = DAylsugJ
Nov 29 19:20:17 user nova-compute[75235]: node.session.auth.password = ***
Nov 29 19:20:17 user nova-compute[75235]: node.session.auth.username_in = <empty>
Nov 29 19:20:17 user nova-compute[75235]: node.session.auth.password_in = <empty>
Nov 29 19:20:17 user nova-compute[75235]: node.session.auth.chap_algs = MD5
Nov 29 19:20:17 user nova-compute[75235]: node.session.timeo.replacement_timeout = 120
Nov 29 19:20:17 user nova-compute[75235]: node.session.err_timeo.abort_timeout = 15
Nov 29 19:20:17 user nova-compute[75235]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 19:20:17 user nova-compute[75235]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 19:20:17 user nova-compute[75235]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.FastAbort = Yes
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.InitialR2T = No
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.ImmediateData = Yes
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.MaxConnections = 1
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 19:20:17 user nova-compute[75235]: node.session.iscsi.ERL = 0
Nov 29 19:20:17 user nova-compute[75235]: node.session.scan = manual
Nov 29 19:20:17 user nova-compute[75235]: node.session.reopen_max = 0
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].address = 172.16.0.220
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].port = 3260
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].startup = manual
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].tcp.window_size = 524288
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].tcp.type_of_service = 0
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].timeo.logout_timeout = 15
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].timeo.login_timeout = 15
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].timeo.auth_timeout = 45
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].iscsi.DataDigest = None
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].iscsi.IFMarker = No
Nov 29 19:20:17 user nova-compute[75235]: node.conn[0].iscsi.OFMarker = No
Nov 29 19:20:17 user nova-compute[75235]: # END RECORD
Nov 29 19:20:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1553e0-3ad1-4d7a-ae22-d1bf97f04710]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-afca85ae-12d0-46f3-bbdd-93c0b707c259 req-e8fe5cb8-de24-4f8b-a308-ee560fe87d1a service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-vif-unplugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afca85ae-12d0-46f3-bbdd-93c0b707c259 req-e8fe5cb8-de24-4f8b-a308-ee560fe87d1a service nova] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afca85ae-12d0-46f3-bbdd-93c0b707c259 req-e8fe5cb8-de24-4f8b-a308-ee560fe87d1a service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-afca85ae-12d0-46f3-bbdd-93c0b707c259 req-e8fe5cb8-de24-4f8b-a308-ee560fe87d1a service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-afca85ae-12d0-46f3-bbdd-93c0b707c259 req-e8fe5cb8-de24-4f8b-a308-ee560fe87d1a service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] No waiting events found dispatching network-vif-unplugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-afca85ae-12d0-46f3-bbdd-93c0b707c259 req-e8fe5cb8-de24-4f8b-a308-ee560fe87d1a service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-vif-unplugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[78099a52-2610-4c7a-891f-19d45729f983]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DAylsugJ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DAylsugJ" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f34ccc-7bc5-4989-aefb-cb2a7c3252e0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DAylsugJ'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7920e-90ef-4bdd-832e-8d14388ba4bc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4666bfce-9944-4d5c-ae52-83ef53c0e644]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:17 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:17 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:17 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:17 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:17 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:17 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:17 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.208s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] HCTL ('35', '0', '0', 0) found on session 41 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e9783-bc3f-4c10-a185-b61951b86063]: (4, ('0 0 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Searching for a device in session 41 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.242s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== connect_volume: return (243ms) {'type': 'block', 'scsi_wwn': '23165643037313135', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165643037313135', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718067018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718067018',id=37,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-1r4jddyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:18:48Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=48a36fcc-48c0-4e84-ab7f-26518d4c57ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "vif_mac": "fa:16:3e:b1:b2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "vif_mac": "fa:16:3e:b1:b2:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'pci_devices' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.base [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Object Instance<48a36fcc-48c0-4e84-ab7f-26518d4c57ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75235) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:20:17 user nova-compute[75235]:   <uuid>48a36fcc-48c0-4e84-ab7f-26518d4c57ca</uuid>
Nov 29 19:20:17 user nova-compute[75235]:   <name>instance-00000025</name>
Nov 29 19:20:17 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:20:17 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:20:17 user nova-compute[75235]:   <metadata>
Nov 29 19:20:17 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:20:17 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:20:17 user nova-compute[75235]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1718067018</nova:name>
Nov 29 19:20:17 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:20:17</nova:creationTime>
Nov 29 19:20:17 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:20:17 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:20:17 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:20:17 user nova-compute[75235]:       <nova:owner>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:user uuid="c547f019112442b7ac97442ce3432365">tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member</nova:user>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:project uuid="9b84f68d6c554611a982ef7326409952">tempest-ServerBootFromVolumeStableRescueTest-1553615524</nova:project>
Nov 29 19:20:17 user nova-compute[75235]:       </nova:owner>
Nov 29 19:20:17 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:20:17 user nova-compute[75235]:       <nova:ports>
Nov 29 19:20:17 user nova-compute[75235]:         <nova:port uuid="4fa7c083-ab1d-4cea-9491-8a975ac73015">
Nov 29 19:20:17 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 19:20:17 user nova-compute[75235]:         </nova:port>
Nov 29 19:20:17 user nova-compute[75235]:       </nova:ports>
Nov 29 19:20:17 user nova-compute[75235]:     </nova:instance>
Nov 29 19:20:17 user nova-compute[75235]:   </metadata>
Nov 29 19:20:17 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:20:17 user nova-compute[75235]:     <system>
Nov 29 19:20:17 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:20:17 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:20:17 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:20:17 user nova-compute[75235]:       <entry name="serial">48a36fcc-48c0-4e84-ab7f-26518d4c57ca</entry>
Nov 29 19:20:17 user nova-compute[75235]:       <entry name="uuid">48a36fcc-48c0-4e84-ab7f-26518d4c57ca</entry>
Nov 29 19:20:17 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:20:17 user nova-compute[75235]:     </system>
Nov 29 19:20:17 user nova-compute[75235]:   </sysinfo>
Nov 29 19:20:17 user nova-compute[75235]:   <os>
Nov 29 19:20:17 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:20:17 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:20:17 user nova-compute[75235]:   </os>
Nov 29 19:20:17 user nova-compute[75235]:   <features>
Nov 29 19:20:17 user nova-compute[75235]:     <acpi/>
Nov 29 19:20:17 user nova-compute[75235]:     <apic/>
Nov 29 19:20:17 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:20:17 user nova-compute[75235]:   </features>
Nov 29 19:20:17 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:20:17 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:20:17 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:20:17 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:20:17 user nova-compute[75235]:   </clock>
Nov 29 19:20:17 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:20:17 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:20:17 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:20:17 user nova-compute[75235]:   </cpu>
Nov 29 19:20:17 user nova-compute[75235]:   <devices>
Nov 29 19:20:17 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:20:17 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:20:17 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:20:17 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:20:17 user nova-compute[75235]:       <serial>d399a62f-5fe1-4c94-9fbd-d886263beffb</serial>
Nov 29 19:20:17 user nova-compute[75235]:     </disk>
Nov 29 19:20:17 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:20:17 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:20:17 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue"/>
Nov 29 19:20:17 user nova-compute[75235]:       <target dev="vdb" bus="virtio"/>
Nov 29 19:20:17 user nova-compute[75235]:       <boot order="1"/>
Nov 29 19:20:17 user nova-compute[75235]:     </disk>
Nov 29 19:20:17 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:20:17 user nova-compute[75235]:       <mac address="fa:16:3e:b1:b2:ad"/>
Nov 29 19:20:17 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:20:17 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:20:17 user nova-compute[75235]:       <target dev="tap4fa7c083-ab"/>
Nov 29 19:20:17 user nova-compute[75235]:     </interface>
Nov 29 19:20:17 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:20:17 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/console.log" append="off"/>
Nov 29 19:20:17 user nova-compute[75235]:     </serial>
Nov 29 19:20:17 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:20:17 user nova-compute[75235]:     <video>
Nov 29 19:20:17 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:20:17 user nova-compute[75235]:     </video>
Nov 29 19:20:17 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:20:17 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:20:17 user nova-compute[75235]:     </rng>
Nov 29 19:20:17 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:20:17 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:20:17 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:20:17 user nova-compute[75235]:     </memballoon>
Nov 29 19:20:17 user nova-compute[75235]:   </devices>
Nov 29 19:20:17 user nova-compute[75235]: </domain>
Nov 29 19:20:17 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:20:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance destroyed successfully.
Nov 29 19:20:17 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Instance destroyed successfully.
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.objects.instance [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lazy-loading 'resources' on Instance uuid c1d8be89-d905-43dc-8d73-4632fa1e7227 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1075362989',display_name='tempest-ServerActionsTestOtherA-server-1075362989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1075362989',id=5,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfH2ajbVfbfJhkyf4KxJD6mxfE4JVQIk+esHapH2Jjiwy7tnKLVLXETSIiHIHkW/k5T5Q9S/inKFRzgEE7eB77C84okgsktbTTwbXn01aACx5KvHLEydGwrquuscZWmQg==',key_name='tempest-keypair-1143981594',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68dafa45545c46169abd1cad11ba15cc',ramdisk_id='',reservation_id='r-ng2kh00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-279549641',owner_user_name='tempest-ServerActionsTestOtherA-279549641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:01:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d98bb13233f447295cf54cb5b1574e8',uuid=c1d8be89-d905-43dc-8d73-4632fa1e7227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converting VIF {"id": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "address": "fa:16:3e:26:f0:81", "network": {"id": "39042c8f-5113-4761-9fb8-ed2ecfdfe5ff", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1062089477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68dafa45545c46169abd1cad11ba15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28cea0d8-5b", "ovs_interfaceid": "28cea0d8-5bab-4184-ad2f-5e9bc62110db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG os_vif [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28cea0d8-5b, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] No VIF found with MAC fa:16:3e:b1:b2:ad, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7ac3cbd-43b1-46a2-9547-d07e5378be3c) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:18 user nova-compute[75235]: INFO os_vif [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:f0:81,bridge_name='br-int',has_traffic_filtering=True,id=28cea0d8-5bab-4184-ad2f-5e9bc62110db,network=Network(39042c8f-5113-4761-9fb8-ed2ecfdfe5ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28cea0d8-5b')
Nov 29 19:20:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Deleting instance files /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227_del
Nov 29 19:20:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Deletion of /opt/stack/data/nova/instances/c1d8be89-d905-43dc-8d73-4632fa1e7227_del complete
Nov 29 19:20:18 user nova-compute[75235]: INFO nova.compute.manager [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 29 19:20:18 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:20:18 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Took 0.52 seconds to deallocate network for instance.
Nov 29 19:20:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:19 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Deleted allocations for instance c1d8be89-d905-43dc-8d73-4632fa1e7227
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-abb9f6e0-c3ec-42df-824b-a90757b4e1c2 tempest-ServerActionsTestOtherA-279549641 tempest-ServerActionsTestOtherA-279549641-project-member] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-d886a3ea-54ad-44ad-87bc-846d22f9b278 req-0e4b50ab-6eed-4690-bc93-6e75e1be9062 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d886a3ea-54ad-44ad-87bc-846d22f9b278 req-0e4b50ab-6eed-4690-bc93-6e75e1be9062 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d886a3ea-54ad-44ad-87bc-846d22f9b278 req-0e4b50ab-6eed-4690-bc93-6e75e1be9062 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d886a3ea-54ad-44ad-87bc-846d22f9b278 req-0e4b50ab-6eed-4690-bc93-6e75e1be9062 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-d886a3ea-54ad-44ad-87bc-846d22f9b278 req-0e4b50ab-6eed-4690-bc93-6e75e1be9062 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:19 user nova-compute[75235]: WARNING nova.compute.manager [req-d886a3ea-54ad-44ad-87bc-846d22f9b278 req-0e4b50ab-6eed-4690-bc93-6e75e1be9062 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state active and task_state rescuing.
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] Acquiring lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] Lock "c1d8be89-d905-43dc-8d73-4632fa1e7227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] No waiting events found dispatching network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:19 user nova-compute[75235]: WARNING nova.compute.manager [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received unexpected event network-vif-plugged-28cea0d8-5bab-4184-ad2f-5e9bc62110db for instance with vm_state deleted and task_state None.
Nov 29 19:20:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-09fd40ad-1779-4112-b970-8072c538dff6 req-0ac9e82a-93b9-42dd-8278-e2fe6add7de0 service nova] [instance: c1d8be89-d905-43dc-8d73-4632fa1e7227] Received event network-vif-deleted-28cea0d8-5bab-4184-ad2f-5e9bc62110db {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-b64aa222-3e62-46b2-b3de-214d6490ca57 req-9553863a-33b7-4835-983a-533954eeb8a6 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b64aa222-3e62-46b2-b3de-214d6490ca57 req-9553863a-33b7-4835-983a-533954eeb8a6 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b64aa222-3e62-46b2-b3de-214d6490ca57 req-9553863a-33b7-4835-983a-533954eeb8a6 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b64aa222-3e62-46b2-b3de-214d6490ca57 req-9553863a-33b7-4835-983a-533954eeb8a6 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:21 user nova-compute[75235]: DEBUG nova.compute.manager [req-b64aa222-3e62-46b2-b3de-214d6490ca57 req-9553863a-33b7-4835-983a-533954eeb8a6 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:21 user nova-compute[75235]: WARNING nova.compute.manager [req-b64aa222-3e62-46b2-b3de-214d6490ca57 req-9553863a-33b7-4835-983a-533954eeb8a6 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state active and task_state rescuing.
Nov 29 19:20:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-aba0c699-37b9-438a-ba2d-d22deb1694c1 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvMUzHep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:20:22 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:22 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:22 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[216525ac-2a1f-4e53-bce8-765a1f88c443]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:20:22 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff1a6b-ea4a-4b04-9e28-acfe2a1d2aee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1] added
Nov 29 19:20:22 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bc2e38-020a-4a0b-9e0c-75592572a2cf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[41438709-5e8f-4966-806f-620c7950057b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvMUzHep {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvMUzHep" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a4c7c-8d0e-4c14-a9c5-4d0bec074648]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvMUzHep'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a25259-b390-4cca-912e-eb1493fdb595]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b345b4c7-807b-4870-8c75-6e87984c910b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58a15f3-ec7a-4304-9eb8-a34bec467861]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260]
Nov 29 19:20:23 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260] successful.
Nov 29 19:20:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f50cc94-ffb8-46d9-bfb0-f22e08f4ab66]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2a84a-a9d3-4c0d-a7e4-581deff9b0ac]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 (non-flash)
Nov 29 19:20:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a017e0a-9b07-4e7f-b25c-c22e5f9ded29]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvMUzHep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26435346635656362', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435346635656362', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'flavor' on Instance uuid a54d682f-41ac-4ab4-b622-3659d507016b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:20:24 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:20:24 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:20:24 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:20:24 user nova-compute[75235]:   <serial>6292c455-e785-424a-83cf-41c98e27b3b1</serial>
Nov 29 19:20:24 user nova-compute[75235]: </disk>
Nov 29 19:20:24 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No VIF found with MAC fa:16:3e:a4:ed:97, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:20:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0a7a2378-995d-44c6-b81a-e7465aa21b4f tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.858s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:28 user nova-compute[75235]: INFO nova.compute.manager [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Detaching volume 6292c455-e785-424a-83cf-41c98e27b3b1
Nov 29 19:20:28 user nova-compute[75235]: INFO nova.virt.block_device [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Attempting to driver detach volume 6292c455-e785-424a-83cf-41c98e27b3b1 from mountpoint /dev/vdb
Nov 29 19:20:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Attempting to detach device vdb from instance a54d682f-41ac-4ab4-b622-3659d507016b from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:20:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:20:28 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:20:28 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:20:28 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:20:28 user nova-compute[75235]:   <serial>6292c455-e785-424a-83cf-41c98e27b3b1</serial>
Nov 29 19:20:28 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:20:28 user nova-compute[75235]: </disk>
Nov 29 19:20:28 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:20:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully detached device vdb from instance a54d682f-41ac-4ab4-b622-3659d507016b from the persistent domain config.
Nov 29 19:20:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a54d682f-41ac-4ab4-b622-3659d507016b from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:20:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:20:28 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:20:28 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:20:28 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:20:28 user nova-compute[75235]:   <serial>6292c455-e785-424a-83cf-41c98e27b3b1</serial>
Nov 29 19:20:28 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:20:28 user nova-compute[75235]: </disk>
Nov 29 19:20:28 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:20:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a54d682f-41ac-4ab4-b622-3659d507016b {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:20:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:45 user nova-compute[75235]: INFO nova.compute.manager [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Terminating instance
Nov 29 19:20:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-c9cc0c5d-b473-4289-bf89-564cffad3de9 req-b12fc373-7b06-41e7-bb25-5cf76b1633cc service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-unplugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c9cc0c5d-b473-4289-bf89-564cffad3de9 req-b12fc373-7b06-41e7-bb25-5cf76b1633cc service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c9cc0c5d-b473-4289-bf89-564cffad3de9 req-b12fc373-7b06-41e7-bb25-5cf76b1633cc service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c9cc0c5d-b473-4289-bf89-564cffad3de9 req-b12fc373-7b06-41e7-bb25-5cf76b1633cc service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-c9cc0c5d-b473-4289-bf89-564cffad3de9 req-b12fc373-7b06-41e7-bb25-5cf76b1633cc service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-unplugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-c9cc0c5d-b473-4289-bf89-564cffad3de9 req-b12fc373-7b06-41e7-bb25-5cf76b1633cc service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-unplugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:20:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Instance destroyed successfully.
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lazy-loading 'resources' on Instance uuid 2270adba-8fe5-4334-83c3-0adf678b22fd {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-557921067',display_name='tempest-TestMinimumBasicScenario-server-557921067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-557921067',id=34,image_ref='f6fe8492-a62d-4248-ace4-7c82a6e037c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqfcdEytz1BIzpr4je2pqaAYwIUGawBipy6BMPyUsJ65Iow2QkVmTiOiMvhdfOc22t1CjDne4kQoDJtgiUcLGcanLkCfMprIdUMnqCkVIiPSEMm1lMAsvTgNSDQ0s65eg==',key_name='tempest-TestMinimumBasicScenario-1043254627',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8731c8d62643ada4847f70bdb57d4e',ramdisk_id='',reservation_id='r-0hdo86rs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f6fe8492-a62d-4248-ace4-7c82a6e037c8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-937004198',owner_user_name='tempest-TestMinimumBasicScenario-937004198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:18:06Z,user_data=None,user_id='3b20e89d8a3f4c29a3e97aceccff1ac6',uuid=2270adba-8fe5-4334-83c3-0adf678b22fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converting VIF {"id": "6b034b10-f86b-4912-a6df-b9c5334a816c", "address": "fa:16:3e:d1:d8:47", "network": {"id": "8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-558941448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8731c8d62643ada4847f70bdb57d4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b034b10-f8", "ovs_interfaceid": "6b034b10-f86b-4912-a6df-b9c5334a816c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG os_vif [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b034b10-f8, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96635890-9b9e-4cd0-b3be-80ea5a21d060) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:46 user nova-compute[75235]: INFO os_vif [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:d8:47,bridge_name='br-int',has_traffic_filtering=True,id=6b034b10-f86b-4912-a6df-b9c5334a816c,network=Network(8e9475ba-8d7a-4a44-9f01-6e997a6e3ebd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b034b10-f8')
Nov 29 19:20:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Deleting instance files /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd_del
Nov 29 19:20:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Deletion of /opt/stack/data/nova/instances/2270adba-8fe5-4334-83c3-0adf678b22fd_del complete
Nov 29 19:20:46 user nova-compute[75235]: INFO nova.compute.manager [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 19:20:46 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:20:46 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:20:47 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:20:47 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Took 0.63 seconds to deallocate network for instance.
Nov 29 19:20:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:47 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:20:47 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:20:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:47 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Deleted allocations for instance 2270adba-8fe5-4334-83c3-0adf678b22fd
Nov 29 19:20:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d877e1ae-118d-4487-9dac-3170d246dd64 tempest-TestMinimumBasicScenario-937004198 tempest-TestMinimumBasicScenario-937004198-project-member] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] Acquiring lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] Lock "2270adba-8fe5-4334-83c3-0adf678b22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] No waiting events found dispatching network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:20:48 user nova-compute[75235]: WARNING nova.compute.manager [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received unexpected event network-vif-plugged-6b034b10-f86b-4912-a6df-b9c5334a816c for instance with vm_state deleted and task_state None.
Nov 29 19:20:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-caa30b39-be2e-4e23-97e0-6a19cd1aec24 req-2385b3e4-934d-4bbe-b066-2d77d333d10e service nova] [instance: 2270adba-8fe5-4334-83c3-0adf678b22fd] Received event network-vif-deleted-6b034b10-f86b-4912-a6df-b9c5334a816c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:20:48 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a54d682f-41ac-4ab4-b622-3659d507016b is timed out.
Nov 29 19:20:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully detached device vdb from instance a54d682f-41ac-4ab4-b622-3659d507016b from the live domain config.
Nov 29 19:20:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvMUzHep', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:20:48 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2cb531-94d3-4977-9647-72bdb0b51b0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:20:48 user nova-compute[75235]: No targets found.
Nov 29 19:20:48 user nova-compute[75235]: iSNS:
Nov 29 19:20:48 user nova-compute[75235]: No targets found.
Nov 29 19:20:48 user nova-compute[75235]: STATIC:
Nov 29 19:20:48 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:20:48 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:48 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:48 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1
Nov 29 19:20:48 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:48 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:48 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:20:48 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:48 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:48 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a
Nov 29 19:20:48 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:48 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:48 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:20:48 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:20:48 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:20:48 user nova-compute[75235]: FIRMWARE:
Nov 29 19:20:48 user nova-compute[75235]: No targets found.
Nov 29 19:20:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:20:48 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:20:48 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0c371a-f69b-47c7-8597-138630b4f15c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7675d13e-ad7e-47f7-86be-e6c3c50c862c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 (non-flash)
Nov 29 19:20:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:20:48 user nova-compute[75235]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 (non-flash)
Nov 29 19:20:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56624aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe36676-9ef4-47ff-a38a-0e27d8005238]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c678c46-010e-4c79-b1a0-9aee3c6b338e]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6ef87-98ac-4f87-b305-966d0dcb2551]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1310c05-0f5d-44ce-9123-851a9e585a86]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b89ef-90e5-42e8-8861-af9d9d8de8f9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1e422f-985d-48ef-ba45-c12576465535]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260]
Nov 29 19:20:48 user nova-compute[75235]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1, portal: 172.16.0.220,3260] successful.
Nov 29 19:20:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6292c455-e785-424a-83cf-41c98e27b3b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e3dd35-cff6-43ff-ac17-6b08426edc06]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] <== disconnect_volume: return (326ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:20:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:20:49 user nova-compute[75235]: DEBUG nova.objects.instance [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'flavor' on Instance uuid a54d682f-41ac-4ab4-b622-3659d507016b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:20:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b3ef88cf-9d59-4eca-b147-338fa90822f4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:20:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:20:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:04 user nova-compute[75235]: INFO nova.compute.manager [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Terminating instance
Nov 29 19:21:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-908ab5be-e005-4857-bd72-7aecebda60a9 req-c2cab08a-5302-4854-8c2d-b9b9cfd9ad65 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-vif-unplugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-908ab5be-e005-4857-bd72-7aecebda60a9 req-c2cab08a-5302-4854-8c2d-b9b9cfd9ad65 service nova] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-908ab5be-e005-4857-bd72-7aecebda60a9 req-c2cab08a-5302-4854-8c2d-b9b9cfd9ad65 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-908ab5be-e005-4857-bd72-7aecebda60a9 req-c2cab08a-5302-4854-8c2d-b9b9cfd9ad65 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-908ab5be-e005-4857-bd72-7aecebda60a9 req-c2cab08a-5302-4854-8c2d-b9b9cfd9ad65 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] No waiting events found dispatching network-vif-unplugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-908ab5be-e005-4857-bd72-7aecebda60a9 req-c2cab08a-5302-4854-8c2d-b9b9cfd9ad65 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-vif-unplugged-a4f618f1-8030-46b5-b239-47ec41cb44fe for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Instance destroyed successfully.
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'resources' on Instance uuid 9daf24ea-1091-4ccb-9b88-066d503a4cca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:19:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618176960',display_name='tempest-TestVolumeBootPattern-server-1618176960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618176960',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-or7koc5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:19:34Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=9daf24ea-1091-4ccb-9b88-066d503a4cca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "address": "fa:16:3e:58:eb:33", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f618f1-80", "ovs_interfaceid": "a4f618f1-8030-46b5-b239-47ec41cb44fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_vif [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4f618f1-80, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e3cb625-9913-4c65-ae0c-f3ec6db065b4) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:05 user nova-compute[75235]: INFO os_vif [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:eb:33,bridge_name='br-int',has_traffic_filtering=True,id=a4f618f1-8030-46b5-b239-47ec41cb44fe,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f618f1-80')
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SJqMsadi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:21:05 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d17605-d3cb-4a80-9a58-b96a065a9650]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:21:05 user nova-compute[75235]: No targets found.
Nov 29 19:21:05 user nova-compute[75235]: iSNS:
Nov 29 19:21:05 user nova-compute[75235]: No targets found.
Nov 29 19:21:05 user nova-compute[75235]: STATIC:
Nov 29 19:21:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:21:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:21:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:21:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:21:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:21:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:21:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a
Nov 29 19:21:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:21:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:21:05 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:21:05 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:21:05 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:21:05 user nova-compute[75235]: FIRMWARE:
Nov 29 19:21:05 user nova-compute[75235]: No targets found.
Nov 29 19:21:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:21:05 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:21:05 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9b4995-1b57-4410-ae94-de53ba9c1325]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf5035-1c8c-42b3-94a5-76a8785a3caf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:21:05 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:21:05 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:21:05 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:21:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:21:05 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:21:05 user nova-compute[75235]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a (non-flash)
Nov 29 19:21:05 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:21:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c77add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c4f3c8-2c06-4276-8e82-c5aaa44beb40]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb09eac-4da3-4352-90f8-22b93d566b40]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6af35a4-d4ae-4d0a-b8b2-5708aa92df1c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cef76b-a2ac-4084-81db-d8f985aed2ff]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf97fd-2569-4ddb-9247-f9859864da4a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0042b08-e2f9-4cff-a04d-c217ef81e1d2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260]
Nov 29 19:21:05 user nova-compute[75235]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a, portal: 172.16.0.220,3260] successful.
Nov 29 19:21:05 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b3fd91-f1c3-4462-8c04-3fcdb9c891d8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== disconnect_volume: return (400ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:21:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Deleting instance files /opt/stack/data/nova/instances/9daf24ea-1091-4ccb-9b88-066d503a4cca_del
Nov 29 19:21:05 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Deletion of /opt/stack/data/nova/instances/9daf24ea-1091-4ccb-9b88-066d503a4cca_del complete
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: INFO nova.compute.manager [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Error from libvirt while getting description of instance-00000026: [Error Code 42] Domain not found: no domain with matching uuid '9daf24ea-1091-4ccb-9b88-066d503a4cca' (instance-00000026): libvirt.libvirtError: Domain not found: no domain with matching uuid '9daf24ea-1091-4ccb-9b88-066d503a4cca' (instance-00000026)
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:21:06 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Took 0.62 seconds to deallocate network for instance.
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] Acquiring lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] No waiting events found dispatching network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:21:06 user nova-compute[75235]: WARNING nova.compute.manager [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received unexpected event network-vif-plugged-a4f618f1-8030-46b5-b239-47ec41cb44fe for instance with vm_state active and task_state deleting.
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-a7d4c514-dcc0-4303-b013-411f1339970b req-8fef0034-45e6-4ebb-9708-7f056898b783 service nova] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Received event network-vif-deleted-a4f618f1-8030-46b5-b239-47ec41cb44fe {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:21:07 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:21:07 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7859MB free_disk=24.890029907226562GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:07 user nova-compute[75235]: INFO nova.compute.manager [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Took 1.02 seconds to detach 1 volumes for instance.
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 9daf24ea-1091-4ccb-9b88-066d503a4cca] Deleting volume: c6c6f1c3-27bd-4c8c-9c59-00bce7fd547a {{(pid=75235) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9daf24ea-1091-4ccb-9b88-066d503a4cca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.286s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:07 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Deleted allocations for instance 9daf24ea-1091-4ccb-9b88-066d503a4cca
Nov 29 19:21:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f35d05eb-8c2a-420e-9195-5b0e36c46cc3 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "9daf24ea-1091-4ccb-9b88-066d503a4cca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.792s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:21:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 9d57cb98-5640-4104-ab59-fc0f4786433c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updating instance_info_cache with network_info: [{"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-9d57cb98-5640-4104-ab59-fc0f4786433c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:21:11 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:21:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:21:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:21:23 user nova-compute[75235]: INFO nova.compute.manager [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] instance snapshotting
Nov 29 19:21:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Beginning live snapshot process
Nov 29 19:21:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json -f qcow2 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgtpspbt6/0882a82ccada4b4dabdc11a8569542f0.delta 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgtpspbt6/0882a82ccada4b4dabdc11a8569542f0.delta 1073741824" returned: 0 in 0.048s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:24 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 19:21:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:21:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:21:25 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75235) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 19:21:25 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 19:21:25 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:21:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgtpspbt6/0882a82ccada4b4dabdc11a8569542f0.delta /opt/stack/data/nova/instances/snapshots/tmpgtpspbt6/0882a82ccada4b4dabdc11a8569542f0 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgtpspbt6/0882a82ccada4b4dabdc11a8569542f0.delta /opt/stack/data/nova/instances/snapshots/tmpgtpspbt6/0882a82ccada4b4dabdc11a8569542f0" returned: 0 in 0.511s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Snapshot extracted, beginning image upload
Nov 29 19:21:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Snapshot image upload complete
Nov 29 19:21:28 user nova-compute[75235]: INFO nova.compute.manager [None req-a61c5cf9-0770-490b-9477-4112b3b31e0a tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Took 5.22 seconds to snapshot the instance on the hypervisor.
Nov 29 19:21:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:21:31 user nova-compute[75235]: INFO nova.compute.claims [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Claim successful on node user
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:21:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:21:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG nova.policy [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ded506037834e6783ff09742a34fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c6fb0f9a004400a2448ad9ecdf7b6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:21:32 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Creating image(s)
Nov 29 19:21:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "/opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "/opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "/opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "8dce12b2f2859ed84f3a4b7165cc3d9a12686930" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "8dce12b2f2859ed84f3a4b7165cc3d9a12686930" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.part --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Successfully created port: c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG nova.virt.images [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] 83a51a05-aba9-4d12-9159-6dfc4b7f8d3b was qcow2, converting to raw {{(pid=75235) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG nova.privsep.utils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75235) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.part /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.converted {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.part /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.converted" returned: 0 in 0.350s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.converted --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "8dce12b2f2859ed84f3a4b7165cc3d9a12686930" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.872s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "8dce12b2f2859ed84f3a4b7165cc3d9a12686930" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "8dce12b2f2859ed84f3a4b7165cc3d9a12686930" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Successfully updated port: c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-changed-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Refreshing instance network info cache due to event network-changed-c86eb44c-3344-44e4-a188-7973dd3c7679. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] Acquiring lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] Acquired lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Refreshing network info cache for port c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930,backing_fmt=raw /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930,backing_fmt=raw /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk 1073741824" returned: 0 in 0.048s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "8dce12b2f2859ed84f3a4b7165cc3d9a12686930" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 --force-share --output=json" returned: 0 in 0.166s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Ensure instance console log exists: /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8c478cd8-3d0a-4ecb-b108-c09174bddb50 req-176372d2-7738-414a-a618-ec52e7899d92 service nova] Releasing lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquired lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:21:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updating instance_info_cache with network_info: [{"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Releasing lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Instance network_info: |[{"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Start _get_guest_xml network_info=[{"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='416966a1b7e9c567d1c85a7b13270972',container_format='bare',created_at=2023-11-29T19:21:23Z,direct_url=<?>,disk_format='qcow2',id=83a51a05-aba9-4d12-9159-6dfc4b7f8d3b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-314653621',owner='e4c6fb0f9a004400a2448ad9ecdf7b6e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T19:21:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '83a51a05-aba9-4d12-9159-6dfc4b7f8d3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:21:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:21:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='416966a1b7e9c567d1c85a7b13270972',container_format='bare',created_at=2023-11-29T19:21:23Z,direct_url=<?>,disk_format='qcow2',id=83a51a05-aba9-4d12-9159-6dfc4b7f8d3b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-314653621',owner='e4c6fb0f9a004400a2448ad9ecdf7b6e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T19:21:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1262927131',display_name='tempest-TestStampPattern-server-1262927131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1262927131',id=39,image_ref='83a51a05-aba9-4d12-9159-6dfc4b7f8d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn3xVYo+E0cU9Uy/fU7QjtKHhvF/x6NUW0tu+5nR3jqZ7TBsLl5Pf/NwyWXbpCskpo3RJCjL48V0UetcFJscnJorQKUz2IcUOa+ov7qXiZkRoF+eVV193Dgm56Xr3HCCw==',key_name='tempest-TestStampPattern-1606459428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',ramdisk_id='',reservation_id='r-zhals5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a54d682f-41ac-4ab4-b622-3659d507016b',image_min_disk='1',image_min_ram='0',image_owner_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',image_owner_project_name='tempest-TestStampPattern-2015071819',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2015071819-project-member',image_user_id='2ded506037834e6783ff09742a34fca0',network_allocated='True',owner_project_name='tempest-TestStampPattern-2015071819',owner_user_name='tempest-TestStampPattern-2015071819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:21:32Z,user_data=None,user_id='2ded506037834e6783ff09742a34fca0',uuid=6135576e-9c21-4d7c-b4f8-e829dd032690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converting VIF {"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'pci_devices' on Instance uuid 6135576e-9c21-4d7c-b4f8-e829dd032690 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:21:35 user nova-compute[75235]:   <uuid>6135576e-9c21-4d7c-b4f8-e829dd032690</uuid>
Nov 29 19:21:35 user nova-compute[75235]:   <name>instance-00000027</name>
Nov 29 19:21:35 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:21:35 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:21:35 user nova-compute[75235]:   <metadata>
Nov 29 19:21:35 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:21:35 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:21:35 user nova-compute[75235]:       <nova:name>tempest-TestStampPattern-server-1262927131</nova:name>
Nov 29 19:21:35 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:21:35</nova:creationTime>
Nov 29 19:21:35 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:21:35 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:21:35 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:21:35 user nova-compute[75235]:       <nova:owner>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:user uuid="2ded506037834e6783ff09742a34fca0">tempest-TestStampPattern-2015071819-project-member</nova:user>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:project uuid="e4c6fb0f9a004400a2448ad9ecdf7b6e">tempest-TestStampPattern-2015071819</nova:project>
Nov 29 19:21:35 user nova-compute[75235]:       </nova:owner>
Nov 29 19:21:35 user nova-compute[75235]:       <nova:root type="image" uuid="83a51a05-aba9-4d12-9159-6dfc4b7f8d3b"/>
Nov 29 19:21:35 user nova-compute[75235]:       <nova:ports>
Nov 29 19:21:35 user nova-compute[75235]:         <nova:port uuid="c86eb44c-3344-44e4-a188-7973dd3c7679">
Nov 29 19:21:35 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 19:21:35 user nova-compute[75235]:         </nova:port>
Nov 29 19:21:35 user nova-compute[75235]:       </nova:ports>
Nov 29 19:21:35 user nova-compute[75235]:     </nova:instance>
Nov 29 19:21:35 user nova-compute[75235]:   </metadata>
Nov 29 19:21:35 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:21:35 user nova-compute[75235]:     <system>
Nov 29 19:21:35 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:21:35 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:21:35 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:21:35 user nova-compute[75235]:       <entry name="serial">6135576e-9c21-4d7c-b4f8-e829dd032690</entry>
Nov 29 19:21:35 user nova-compute[75235]:       <entry name="uuid">6135576e-9c21-4d7c-b4f8-e829dd032690</entry>
Nov 29 19:21:35 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:21:35 user nova-compute[75235]:     </system>
Nov 29 19:21:35 user nova-compute[75235]:   </sysinfo>
Nov 29 19:21:35 user nova-compute[75235]:   <os>
Nov 29 19:21:35 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:21:35 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:21:35 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:21:35 user nova-compute[75235]:   </os>
Nov 29 19:21:35 user nova-compute[75235]:   <features>
Nov 29 19:21:35 user nova-compute[75235]:     <acpi/>
Nov 29 19:21:35 user nova-compute[75235]:     <apic/>
Nov 29 19:21:35 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:21:35 user nova-compute[75235]:   </features>
Nov 29 19:21:35 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:21:35 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:21:35 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:21:35 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:21:35 user nova-compute[75235]:   </clock>
Nov 29 19:21:35 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:21:35 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:21:35 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:21:35 user nova-compute[75235]:   </cpu>
Nov 29 19:21:35 user nova-compute[75235]:   <devices>
Nov 29 19:21:35 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:21:35 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:21:35 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk"/>
Nov 29 19:21:35 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:21:35 user nova-compute[75235]:     </disk>
Nov 29 19:21:35 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:21:35 user nova-compute[75235]:       <mac address="fa:16:3e:90:cb:7b"/>
Nov 29 19:21:35 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:21:35 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:21:35 user nova-compute[75235]:       <target dev="tapc86eb44c-33"/>
Nov 29 19:21:35 user nova-compute[75235]:     </interface>
Nov 29 19:21:35 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:21:35 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/console.log" append="off"/>
Nov 29 19:21:35 user nova-compute[75235]:     </serial>
Nov 29 19:21:35 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:21:35 user nova-compute[75235]:     <video>
Nov 29 19:21:35 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:21:35 user nova-compute[75235]:     </video>
Nov 29 19:21:35 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:21:35 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:21:35 user nova-compute[75235]:     </rng>
Nov 29 19:21:35 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:21:35 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:21:35 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:21:35 user nova-compute[75235]:     </memballoon>
Nov 29 19:21:35 user nova-compute[75235]:   </devices>
Nov 29 19:21:35 user nova-compute[75235]: </domain>
Nov 29 19:21:35 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1262927131',display_name='tempest-TestStampPattern-server-1262927131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1262927131',id=39,image_ref='83a51a05-aba9-4d12-9159-6dfc4b7f8d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn3xVYo+E0cU9Uy/fU7QjtKHhvF/x6NUW0tu+5nR3jqZ7TBsLl5Pf/NwyWXbpCskpo3RJCjL48V0UetcFJscnJorQKUz2IcUOa+ov7qXiZkRoF+eVV193Dgm56Xr3HCCw==',key_name='tempest-TestStampPattern-1606459428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',ramdisk_id='',reservation_id='r-zhals5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a54d682f-41ac-4ab4-b622-3659d507016b',image_min_disk='1',image_min_ram='0',image_owner_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',image_owner_project_name='tempest-TestStampPattern-2015071819',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2015071819-project-member',image_user_id='2ded506037834e6783ff09742a34fca0',network_allocated='True',owner_project_name='tempest-TestStampPattern-2015071819',owner_user_name='tempest-TestStampPattern-2015071819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:21:32Z,user_data=None,user_id='2ded506037834e6783ff09742a34fca0',uuid=6135576e-9c21-4d7c-b4f8-e829dd032690,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converting VIF {"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG os_vif [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e0e6430-6d70-5015-b52f-76db3da5dc41', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc86eb44c-33, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc86eb44c-33, col_values=(('qos', UUID('b4beb3f2-28ac-4b59-9424-dac90b13d49c')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc86eb44c-33, col_values=(('external_ids', {'iface-id': 'c86eb44c-3344-44e4-a188-7973dd3c7679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:cb:7b', 'vm-uuid': '6135576e-9c21-4d7c-b4f8-e829dd032690'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:35 user nova-compute[75235]: INFO os_vif [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33')
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:21:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No VIF found with MAC fa:16:3e:90:cb:7b, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-13316d69-56a9-4373-831e-e78c2ad00fd4 req-d98e6401-d171-466a-80fa-0928d8b81144 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13316d69-56a9-4373-831e-e78c2ad00fd4 req-d98e6401-d171-466a-80fa-0928d8b81144 service nova] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13316d69-56a9-4373-831e-e78c2ad00fd4 req-d98e6401-d171-466a-80fa-0928d8b81144 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-13316d69-56a9-4373-831e-e78c2ad00fd4 req-d98e6401-d171-466a-80fa-0928d8b81144 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-13316d69-56a9-4373-831e-e78c2ad00fd4 req-d98e6401-d171-466a-80fa-0928d8b81144 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] No waiting events found dispatching network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:21:36 user nova-compute[75235]: WARNING nova.compute.manager [req-13316d69-56a9-4373-831e-e78c2ad00fd4 req-d98e6401-d171-466a-80fa-0928d8b81144 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received unexpected event network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 for instance with vm_state building and task_state spawning.
Nov 29 19:21:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:21:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:21:38 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Instance spawned successfully.
Nov 29 19:21:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:21:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:21:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:21:38 user nova-compute[75235]: INFO nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 29 19:21:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:21:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-085a479f-5a76-44d2-a0ec-fd5c36e7b6c5 req-55b20385-2c82-4a11-b989-6bb386c5b218 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:21:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-085a479f-5a76-44d2-a0ec-fd5c36e7b6c5 req-55b20385-2c82-4a11-b989-6bb386c5b218 service nova] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:21:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-085a479f-5a76-44d2-a0ec-fd5c36e7b6c5 req-55b20385-2c82-4a11-b989-6bb386c5b218 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:21:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-085a479f-5a76-44d2-a0ec-fd5c36e7b6c5 req-55b20385-2c82-4a11-b989-6bb386c5b218 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-085a479f-5a76-44d2-a0ec-fd5c36e7b6c5 req-55b20385-2c82-4a11-b989-6bb386c5b218 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] No waiting events found dispatching network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:21:39 user nova-compute[75235]: WARNING nova.compute.manager [req-085a479f-5a76-44d2-a0ec-fd5c36e7b6c5 req-55b20385-2c82-4a11-b989-6bb386c5b218 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received unexpected event network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 for instance with vm_state active and task_state None.
Nov 29 19:21:39 user nova-compute[75235]: INFO nova.compute.manager [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Took 7.60 seconds to build instance.
Nov 29 19:21:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7a6ecab0-ebb4-4012-b059-4aa3fbf8b8c4 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.868s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:21:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:21:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:00 user nova-compute[75235]: INFO nova.compute.manager [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Unrescuing
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG nova.objects.instance [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'flavor' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-c160b75a-2078-473e-b8fc-3d2997343066 req-0e1c38f9-add4-45f1-8dd6-8275d86e122f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c160b75a-2078-473e-b8fc-3d2997343066 req-0e1c38f9-add4-45f1-8dd6-8275d86e122f service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c160b75a-2078-473e-b8fc-3d2997343066 req-0e1c38f9-add4-45f1-8dd6-8275d86e122f service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c160b75a-2078-473e-b8fc-3d2997343066 req-0e1c38f9-add4-45f1-8dd6-8275d86e122f service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-c160b75a-2078-473e-b8fc-3d2997343066 req-0e1c38f9-add4-45f1-8dd6-8275d86e122f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:00 user nova-compute[75235]: WARNING nova.compute.manager [req-c160b75a-2078-473e-b8fc-3d2997343066 req-0e1c38f9-add4-45f1-8dd6-8275d86e122f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance destroyed successfully.
Nov 29 19:22:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:22:01 user nova-compute[75235]: INFO nova.compute.claims [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Claim successful on node user
Nov 29 19:22:01 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:22:02 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.policy [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e390c65285a14e01ad47bad2830538d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7a2206ddff474597fe976a3ca04f00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:22:02 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Creating image(s)
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "/opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "/opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "/opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk 1073741824" returned: 0 in 0.067s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Successfully created port: dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.213s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-7bc45b16-fcfe-46d1-94ff-ae16999514ea req-14dfd8aa-8627-44d1-af62-718b1d77ceeb service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7bc45b16-fcfe-46d1-94ff-ae16999514ea req-14dfd8aa-8627-44d1-af62-718b1d77ceeb service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7bc45b16-fcfe-46d1-94ff-ae16999514ea req-14dfd8aa-8627-44d1-af62-718b1d77ceeb service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7bc45b16-fcfe-46d1-94ff-ae16999514ea req-14dfd8aa-8627-44d1-af62-718b1d77ceeb service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-7bc45b16-fcfe-46d1-94ff-ae16999514ea req-14dfd8aa-8627-44d1-af62-718b1d77ceeb service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:02 user nova-compute[75235]: WARNING nova.compute.manager [req-7bc45b16-fcfe-46d1-94ff-ae16999514ea req-14dfd8aa-8627-44d1-af62-718b1d77ceeb service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Cannot resize image /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Ensure instance console log exists: /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Successfully updated port: dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquired lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:22:03 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.neutron [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updating instance_info_cache with network_info: [{"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Releasing lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Instance network_info: |[{"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Start _get_guest_xml network_info=[{"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:22:04 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:04 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1222290',id=40,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF08Irm6U2Hj1gSD34rPZLJiMYkIq16YHovUwA+QbTQrvju5m8QTrgamnwBF+fEE4DhyouJYpga9GaXakR5Ih8uXCgJLyOPeqUySA/QYGjGaUGTr2Yn3/fVTuT61l9Pe8w==',key_name='tempest-keypair-1475719509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7a2206ddff474597fe976a3ca04f00',ramdisk_id='',reservation_id='r-v3566gxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-97871556',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e390c65285a14e01ad47bad2830538d6',uuid=f20a7f8c-f2e8-4b9a-9652-2032c9159cb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Converting VIF {"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lazy-loading 'pci_devices' on Instance uuid f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:22:04 user nova-compute[75235]:   <uuid>f20a7f8c-f2e8-4b9a-9652-2032c9159cb7</uuid>
Nov 29 19:22:04 user nova-compute[75235]:   <name>instance-00000028</name>
Nov 29 19:22:04 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:22:04 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:22:04 user nova-compute[75235]:   <metadata>
Nov 29 19:22:04 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:22:04 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:22:04 user nova-compute[75235]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705</nova:name>
Nov 29 19:22:04 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:22:04</nova:creationTime>
Nov 29 19:22:04 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:22:04 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:22:04 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:22:04 user nova-compute[75235]:       <nova:owner>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:user uuid="e390c65285a14e01ad47bad2830538d6">tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member</nova:user>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:project uuid="fe7a2206ddff474597fe976a3ca04f00">tempest-TestServerVolumeAttachScenarioOldVersion-97871556</nova:project>
Nov 29 19:22:04 user nova-compute[75235]:       </nova:owner>
Nov 29 19:22:04 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:22:04 user nova-compute[75235]:       <nova:ports>
Nov 29 19:22:04 user nova-compute[75235]:         <nova:port uuid="dc3904a1-c0f9-44f2-baf0-dd8b240d1b45">
Nov 29 19:22:04 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 19:22:04 user nova-compute[75235]:         </nova:port>
Nov 29 19:22:04 user nova-compute[75235]:       </nova:ports>
Nov 29 19:22:04 user nova-compute[75235]:     </nova:instance>
Nov 29 19:22:04 user nova-compute[75235]:   </metadata>
Nov 29 19:22:04 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:22:04 user nova-compute[75235]:     <system>
Nov 29 19:22:04 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:22:04 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:22:04 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:22:04 user nova-compute[75235]:       <entry name="serial">f20a7f8c-f2e8-4b9a-9652-2032c9159cb7</entry>
Nov 29 19:22:04 user nova-compute[75235]:       <entry name="uuid">f20a7f8c-f2e8-4b9a-9652-2032c9159cb7</entry>
Nov 29 19:22:04 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:22:04 user nova-compute[75235]:     </system>
Nov 29 19:22:04 user nova-compute[75235]:   </sysinfo>
Nov 29 19:22:04 user nova-compute[75235]:   <os>
Nov 29 19:22:04 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:22:04 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:22:04 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:22:04 user nova-compute[75235]:   </os>
Nov 29 19:22:04 user nova-compute[75235]:   <features>
Nov 29 19:22:04 user nova-compute[75235]:     <acpi/>
Nov 29 19:22:04 user nova-compute[75235]:     <apic/>
Nov 29 19:22:04 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:22:04 user nova-compute[75235]:   </features>
Nov 29 19:22:04 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:22:04 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:22:04 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:22:04 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:22:04 user nova-compute[75235]:   </clock>
Nov 29 19:22:04 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:22:04 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:22:04 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:22:04 user nova-compute[75235]:   </cpu>
Nov 29 19:22:04 user nova-compute[75235]:   <devices>
Nov 29 19:22:04 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:22:04 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:22:04 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk"/>
Nov 29 19:22:04 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:22:04 user nova-compute[75235]:     </disk>
Nov 29 19:22:04 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:22:04 user nova-compute[75235]:       <mac address="fa:16:3e:cb:c4:0c"/>
Nov 29 19:22:04 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:22:04 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:22:04 user nova-compute[75235]:       <target dev="tapdc3904a1-c0"/>
Nov 29 19:22:04 user nova-compute[75235]:     </interface>
Nov 29 19:22:04 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:22:04 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/console.log" append="off"/>
Nov 29 19:22:04 user nova-compute[75235]:     </serial>
Nov 29 19:22:04 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:22:04 user nova-compute[75235]:     <video>
Nov 29 19:22:04 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:22:04 user nova-compute[75235]:     </video>
Nov 29 19:22:04 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:22:04 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:22:04 user nova-compute[75235]:     </rng>
Nov 29 19:22:04 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:22:04 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:22:04 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:22:04 user nova-compute[75235]:     </memballoon>
Nov 29 19:22:04 user nova-compute[75235]:   </devices>
Nov 29 19:22:04 user nova-compute[75235]: </domain>
Nov 29 19:22:04 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1222290',id=40,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF08Irm6U2Hj1gSD34rPZLJiMYkIq16YHovUwA+QbTQrvju5m8QTrgamnwBF+fEE4DhyouJYpga9GaXakR5Ih8uXCgJLyOPeqUySA/QYGjGaUGTr2Yn3/fVTuT61l9Pe8w==',key_name='tempest-keypair-1475719509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe7a2206ddff474597fe976a3ca04f00',ramdisk_id='',reservation_id='r-v3566gxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-97871556',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e390c65285a14e01ad47bad2830538d6',uuid=f20a7f8c-f2e8-4b9a-9652-2032c9159cb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Converting VIF {"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG os_vif [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a94c8726-ded4-53d8-a76a-bd22b379bf02', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc3904a1-c0, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc3904a1-c0, col_values=(('qos', UUID('3b91a059-59f9-4556-9310-6a40d9737b76')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc3904a1-c0, col_values=(('external_ids', {'iface-id': 'dc3904a1-c0f9-44f2-baf0-dd8b240d1b45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:c4:0c', 'vm-uuid': 'f20a7f8c-f2e8-4b9a-9652-2032c9159cb7'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: INFO os_vif [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0')
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] No VIF found with MAC fa:16:3e:cb:c4:0c, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:04 user nova-compute[75235]: INFO nova.compute.manager [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Unrescuing
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquired lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.network.neutron [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating instance_info_cache with network_info: [{"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Releasing lock "refresh_cache-48a36fcc-48c0-4e84-ab7f-26518d4c57ca" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:04 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'flavor' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:05 user nova-compute[75235]: WARNING nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:05 user nova-compute[75235]: WARNING nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-changed-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Refreshing instance network info cache due to event network-changed-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Acquiring lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Acquired lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Refreshing network info cache for port dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-77e54679-b763-4c39-9644-759d0dfbe166 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-536f5bf9-e76a-4458-919c-bf79161b2edc req-d28710bb-0fcb-46b4-974e-17d187607d58 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-536f5bf9-e76a-4458-919c-bf79161b2edc req-d28710bb-0fcb-46b4-974e-17d187607d58 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-536f5bf9-e76a-4458-919c-bf79161b2edc req-d28710bb-0fcb-46b4-974e-17d187607d58 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-536f5bf9-e76a-4458-919c-bf79161b2edc req-d28710bb-0fcb-46b4-974e-17d187607d58 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-536f5bf9-e76a-4458-919c-bf79161b2edc req-d28710bb-0fcb-46b4-974e-17d187607d58 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:05 user nova-compute[75235]: WARNING nova.compute.manager [req-536f5bf9-e76a-4458-919c-bf79161b2edc req-d28710bb-0fcb-46b4-974e-17d187607d58 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updated VIF entry in instance network info cache for port dc3904a1-c0f9-44f2-baf0-dd8b240d1b45. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updating instance_info_cache with network_info: [{"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-56784620-d3e2-409f-a6f1-f19f190b34fa req-e49177a5-e432-4178-9a7b-816fe4570ddc service nova] Releasing lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.281s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance destroyed successfully.
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:07 user nova-compute[75235]: WARNING nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] No waiting events found dispatching network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:07 user nova-compute[75235]: WARNING nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received unexpected event network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 for instance with vm_state building and task_state spawning.
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] No waiting events found dispatching network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:07 user nova-compute[75235]: WARNING nova.compute.manager [req-b3cd6954-9521-4764-b88e-1a26e094c01e req-08c01be9-0c01-4834-9054-41e571f2c964 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received unexpected event network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 for instance with vm_state building and task_state spawning.
Nov 29 19:22:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Instance spawned successfully.
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:08 user nova-compute[75235]: INFO nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:10 user nova-compute[75235]: WARNING nova.compute.manager [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG nova.compute.manager [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:10 user nova-compute[75235]: WARNING nova.compute.manager [req-b3781a0a-9967-42f8-b51c-dfa13ab55b9e req-45c47869-f128-4bcc-a26a-ff5957832840 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state rescued and task_state unrescuing.
Nov 29 19:22:10 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4caa0991-5460-45f2-8cb0-36a48ea92c8a tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:22:10 user nova-compute[75235]: INFO nova.compute.manager [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Took 9.17 seconds to build instance.
Nov 29 19:22:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:22:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8048MB free_disk=24.771827697753906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0fb70bd6-51d8-4114-a499-7fea2d54a1cb tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.290s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 6135576e-9c21-4d7c-b4f8-e829dd032690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:22:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.930s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:22:13 user nova-compute[75235]: INFO nova.compute.claims [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Claim successful on node user
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [{"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-5380cf96-db98-487d-a6b5-bec6948e12a9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:22:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.policy [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20d52323a014526b5ebd121d637f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e15c428b2f43b9a2e5850370c4f938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:22:14 user nova-compute[75235]: INFO nova.virt.block_device [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Booting with volume 7ff99555-9e3a-4e95-82a6-783254f134f7 at /dev/vda
Nov 29 19:22:14 user nova-compute[75235]: DEBUG os_brick.utils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7abd9e-a2a5-4704-b1ed-7e9b7c07ded9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[253df282-a78c-45ef-b9b4-843e8645c1bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d87fab-1d06-418f-b9f1-c2d5bc5d974a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99fe15-ffb5-4be7-a997-9800d4adf5c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:22:14 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:22:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2d05cb-b0ff-4c0f-b8eb-ec9aa5faf7be]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG os_brick.utils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updating existing volume attachment record: ea217322-3dda-44e2-a0ab-7e96ac5092ad {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:22:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Successfully created port: 8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:22:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Successfully updated port: 8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquired lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-changed-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Refreshing instance network info cache due to event network-changed-8da32f1e-c2bc-43f9-842a-e65671964948. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] Acquiring lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updating instance_info_cache with network_info: [{"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Releasing lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Instance network_info: |[{"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] Acquired lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Refreshing network info cache for port 8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updated VIF entry in instance network info cache for port 8da32f1e-c2bc-43f9-842a-e65671964948. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:22:16 user nova-compute[75235]: DEBUG nova.network.neutron [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updating instance_info_cache with network_info: [{"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ee991fc0-ce28-4dc6-9874-9d68b3ce8b28 req-fd900b90-dd47-4891-a8b5-1577de253772 service nova] Releasing lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:22:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Creating image(s)
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Ensure instance console log exists: /opt/stack/data/nova/instances/864ba3bb-968d-48a1-96d1-157a6f3feb18/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Start _get_guest_xml network_info=[{"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'ea217322-3dda-44e2-a0ab-7e96ac5092ad', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSEikvbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '864ba3bb-968d-48a1-96d1-157a6f3feb18', 'attached_at': '', 'detached_at': '', 'volume_id': '7ff99555-9e3a-4e95-82a6-783254f134f7', 'serial': '7ff99555-9e3a-4e95-82a6-783254f134f7'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:22:23 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:23 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSEikvbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:22:23 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:22:23 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:22:23 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7313d18-1f2a-4b81-b181-dd8bfaec7bb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:22:23 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[34447996-712f-4e83-8ee3-49596d461b1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7] added
Nov 29 19:22:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8284e-c733-4744-a0a8-378c4a54ace0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bf7618-c8c6-4e34-8dfc-ef542e451493]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSEikvbh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSEikvbh" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe2e23-05e5-4f1b-9d3a-6c0b643fb5f6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CSEikvbh'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ca9f44-d1dd-41ea-8b9f-35880c74df7a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc4939-4b17-4dcd-88b2-8cb2d0285e73]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8b96d6-3e89-4c1f-b8d0-34ee48031176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260]
Nov 29 19:22:23 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260] successful.
Nov 29 19:22:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6cd8d-a72f-4847-a01c-07dfeb604446]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f81113-3f71-4a7e-a9d2-ac23f404de0e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:22:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c0a1dd-06d8-471f-9135-faf8e399a936]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:22:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSEikvbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26237353164363432', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237353164363432', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-31627254',display_name='tempest-TestVolumeBootPattern-volume-backed-server-31627254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-31627254',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhYpBGSeLF/GpH0ykGBpELv3UDvXEu/OQXFsAVAmbg7HIak/A/MIiROAQYlE+yv8xVcFda+MNeY2HdQG4kPbF+SZNOTMc8vzTWe7dCNZuQtcrq+8/iQK4RGIioy1BTbVw==',key_name='tempest-keypair-1797251563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-gfl3prah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20d52323a014526b5ebd121d637f4c4',uuid=864ba3bb-968d-48a1-96d1-157a6f3feb18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'pci_devices' on Instance uuid 864ba3bb-968d-48a1-96d1-157a6f3feb18 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:22:24 user nova-compute[75235]:   <uuid>864ba3bb-968d-48a1-96d1-157a6f3feb18</uuid>
Nov 29 19:22:24 user nova-compute[75235]:   <name>instance-00000029</name>
Nov 29 19:22:24 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:22:24 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:22:24 user nova-compute[75235]:   <metadata>
Nov 29 19:22:24 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:22:24 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:22:24 user nova-compute[75235]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-31627254</nova:name>
Nov 29 19:22:24 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:22:23</nova:creationTime>
Nov 29 19:22:24 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:22:24 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:22:24 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:22:24 user nova-compute[75235]:       <nova:owner>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:user uuid="f20d52323a014526b5ebd121d637f4c4">tempest-TestVolumeBootPattern-656128499-project-member</nova:user>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:project uuid="87e15c428b2f43b9a2e5850370c4f938">tempest-TestVolumeBootPattern-656128499</nova:project>
Nov 29 19:22:24 user nova-compute[75235]:       </nova:owner>
Nov 29 19:22:24 user nova-compute[75235]:       <nova:ports>
Nov 29 19:22:24 user nova-compute[75235]:         <nova:port uuid="8da32f1e-c2bc-43f9-842a-e65671964948">
Nov 29 19:22:24 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 19:22:24 user nova-compute[75235]:         </nova:port>
Nov 29 19:22:24 user nova-compute[75235]:       </nova:ports>
Nov 29 19:22:24 user nova-compute[75235]:     </nova:instance>
Nov 29 19:22:24 user nova-compute[75235]:   </metadata>
Nov 29 19:22:24 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:22:24 user nova-compute[75235]:     <system>
Nov 29 19:22:24 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:22:24 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:22:24 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:22:24 user nova-compute[75235]:       <entry name="serial">864ba3bb-968d-48a1-96d1-157a6f3feb18</entry>
Nov 29 19:22:24 user nova-compute[75235]:       <entry name="uuid">864ba3bb-968d-48a1-96d1-157a6f3feb18</entry>
Nov 29 19:22:24 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:22:24 user nova-compute[75235]:     </system>
Nov 29 19:22:24 user nova-compute[75235]:   </sysinfo>
Nov 29 19:22:24 user nova-compute[75235]:   <os>
Nov 29 19:22:24 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:22:24 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:22:24 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:22:24 user nova-compute[75235]:   </os>
Nov 29 19:22:24 user nova-compute[75235]:   <features>
Nov 29 19:22:24 user nova-compute[75235]:     <acpi/>
Nov 29 19:22:24 user nova-compute[75235]:     <apic/>
Nov 29 19:22:24 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:22:24 user nova-compute[75235]:   </features>
Nov 29 19:22:24 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:22:24 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:22:24 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:22:24 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:22:24 user nova-compute[75235]:   </clock>
Nov 29 19:22:24 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:22:24 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:22:24 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:22:24 user nova-compute[75235]:   </cpu>
Nov 29 19:22:24 user nova-compute[75235]:   <devices>
Nov 29 19:22:24 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:22:24 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:22:24 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:22:24 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:22:24 user nova-compute[75235]:       <serial>7ff99555-9e3a-4e95-82a6-783254f134f7</serial>
Nov 29 19:22:24 user nova-compute[75235]:     </disk>
Nov 29 19:22:24 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:22:24 user nova-compute[75235]:       <mac address="fa:16:3e:8e:a3:2d"/>
Nov 29 19:22:24 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:22:24 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:22:24 user nova-compute[75235]:       <target dev="tap8da32f1e-c2"/>
Nov 29 19:22:24 user nova-compute[75235]:     </interface>
Nov 29 19:22:24 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:22:24 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/864ba3bb-968d-48a1-96d1-157a6f3feb18/console.log" append="off"/>
Nov 29 19:22:24 user nova-compute[75235]:     </serial>
Nov 29 19:22:24 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:22:24 user nova-compute[75235]:     <video>
Nov 29 19:22:24 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:22:24 user nova-compute[75235]:     </video>
Nov 29 19:22:24 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:22:24 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:22:24 user nova-compute[75235]:     </rng>
Nov 29 19:22:24 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:22:24 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:22:24 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:22:24 user nova-compute[75235]:     </memballoon>
Nov 29 19:22:24 user nova-compute[75235]:   </devices>
Nov 29 19:22:24 user nova-compute[75235]: </domain>
Nov 29 19:22:24 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-31627254',display_name='tempest-TestVolumeBootPattern-volume-backed-server-31627254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-31627254',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhYpBGSeLF/GpH0ykGBpELv3UDvXEu/OQXFsAVAmbg7HIak/A/MIiROAQYlE+yv8xVcFda+MNeY2HdQG4kPbF+SZNOTMc8vzTWe7dCNZuQtcrq+8/iQK4RGIioy1BTbVw==',key_name='tempest-keypair-1797251563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-gfl3prah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20d52323a014526b5ebd121d637f4c4',uuid=864ba3bb-968d-48a1-96d1-157a6f3feb18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG os_vif [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd425d8e9-33a6-5377-a6a8-9c8ca32e5e38', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8da32f1e-c2, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8da32f1e-c2, col_values=(('qos', UUID('a81b88d5-4f91-4d7f-a714-9b0a3e14b7d2')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8da32f1e-c2, col_values=(('external_ids', {'iface-id': '8da32f1e-c2bc-43f9-842a-e65671964948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:a3:2d', 'vm-uuid': '864ba3bb-968d-48a1-96d1-157a6f3feb18'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:24 user nova-compute[75235]: INFO os_vif [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2')
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:22:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No VIF found with MAC fa:16:3e:8e:a3:2d, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-be011f4d-5307-4aaf-a2c6-0c415dbe677b req-054874a5-3d3b-45e1-acb1-04ff5081816b service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-be011f4d-5307-4aaf-a2c6-0c415dbe677b req-054874a5-3d3b-45e1-acb1-04ff5081816b service nova] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-be011f4d-5307-4aaf-a2c6-0c415dbe677b req-054874a5-3d3b-45e1-acb1-04ff5081816b service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-be011f4d-5307-4aaf-a2c6-0c415dbe677b req-054874a5-3d3b-45e1-acb1-04ff5081816b service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-be011f4d-5307-4aaf-a2c6-0c415dbe677b req-054874a5-3d3b-45e1-acb1-04ff5081816b service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] No waiting events found dispatching network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:26 user nova-compute[75235]: WARNING nova.compute.manager [req-be011f4d-5307-4aaf-a2c6-0c415dbe677b req-054874a5-3d3b-45e1-acb1-04ff5081816b service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received unexpected event network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 for instance with vm_state building and task_state spawning.
Nov 29 19:22:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:22:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Instance spawned successfully.
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:28 user nova-compute[75235]: INFO nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:22:28 user nova-compute[75235]: INFO nova.compute.manager [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Took 14.93 seconds to build instance.
Nov 29 19:22:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cb6206a2-a9d2-4339-b48a-7e7572ea1d02 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.038s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-20af3e5e-1b94-4586-8cb4-eaa2d52496ae req-313ad42a-63c6-4ac1-9561-4d06b6dc0b73 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-20af3e5e-1b94-4586-8cb4-eaa2d52496ae req-313ad42a-63c6-4ac1-9561-4d06b6dc0b73 service nova] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-20af3e5e-1b94-4586-8cb4-eaa2d52496ae req-313ad42a-63c6-4ac1-9561-4d06b6dc0b73 service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-20af3e5e-1b94-4586-8cb4-eaa2d52496ae req-313ad42a-63c6-4ac1-9561-4d06b6dc0b73 service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-20af3e5e-1b94-4586-8cb4-eaa2d52496ae req-313ad42a-63c6-4ac1-9561-4d06b6dc0b73 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] No waiting events found dispatching network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:28 user nova-compute[75235]: WARNING nova.compute.manager [req-20af3e5e-1b94-4586-8cb4-eaa2d52496ae req-313ad42a-63c6-4ac1-9561-4d06b6dc0b73 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received unexpected event network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 for instance with vm_state active and task_state None.
Nov 29 19:22:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:22:48 user nova-compute[75235]: INFO nova.compute.claims [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Claim successful on node user
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:22:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.policy [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aec9d4541474364baae470f90efe2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad88693560a465299e61e263c402de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:22:48 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Creating image(s)
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "/opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "/opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "/opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk 1073741824" returned: 0 in 0.069s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Successfully created port: 0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Cannot resize image /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Ensure instance console log exists: /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Successfully updated port: 0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquired lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-changed-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Refreshing instance network info cache due to event network-changed-0d9e9572-5d93-4473-86ff-82a5cb1eaf32. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] Acquiring lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updating instance_info_cache with network_info: [{"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Releasing lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Instance network_info: |[{"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] Acquired lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Refreshing network info cache for port 0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Start _get_guest_xml network_info=[{"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:22:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:50 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1288015214',display_name='tempest-VolumesSnapshotTestJSON-instance-1288015214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1288015214',id=42,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA7y1i+ggIgACD0j3fRIlEYHytKFjSdvks00fEHSY/x6NuhR0/h34AcbE9aN+P6QQYOT4kFpiXKjfNnI9LYBCoUZTI6GIlLBh6AyBlFZePVsrdNI8yySSwuOgB2fGiaiQ==',key_name='tempest-keypair-1198979514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ad88693560a465299e61e263c402de3',ramdisk_id='',reservation_id='r-m74oku0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1975532199',owner_user_name='tempest-VolumesSnapshotTestJSON-1975532199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aec9d4541474364baae470f90efe2ea',uuid=60faf673-2cc5-463b-8d72-98943c8e4c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converting VIF {"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.objects.instance [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'pci_devices' on Instance uuid 60faf673-2cc5-463b-8d72-98943c8e4c5f {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:22:50 user nova-compute[75235]:   <uuid>60faf673-2cc5-463b-8d72-98943c8e4c5f</uuid>
Nov 29 19:22:50 user nova-compute[75235]:   <name>instance-0000002a</name>
Nov 29 19:22:50 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:22:50 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:22:50 user nova-compute[75235]:   <metadata>
Nov 29 19:22:50 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:22:50 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:22:50 user nova-compute[75235]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1288015214</nova:name>
Nov 29 19:22:50 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:22:50</nova:creationTime>
Nov 29 19:22:50 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:22:50 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:22:50 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:22:50 user nova-compute[75235]:       <nova:owner>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:user uuid="3aec9d4541474364baae470f90efe2ea">tempest-VolumesSnapshotTestJSON-1975532199-project-member</nova:user>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:project uuid="1ad88693560a465299e61e263c402de3">tempest-VolumesSnapshotTestJSON-1975532199</nova:project>
Nov 29 19:22:50 user nova-compute[75235]:       </nova:owner>
Nov 29 19:22:50 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:22:50 user nova-compute[75235]:       <nova:ports>
Nov 29 19:22:50 user nova-compute[75235]:         <nova:port uuid="0d9e9572-5d93-4473-86ff-82a5cb1eaf32">
Nov 29 19:22:50 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:22:50 user nova-compute[75235]:         </nova:port>
Nov 29 19:22:50 user nova-compute[75235]:       </nova:ports>
Nov 29 19:22:50 user nova-compute[75235]:     </nova:instance>
Nov 29 19:22:50 user nova-compute[75235]:   </metadata>
Nov 29 19:22:50 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:22:50 user nova-compute[75235]:     <system>
Nov 29 19:22:50 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:22:50 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:22:50 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:22:50 user nova-compute[75235]:       <entry name="serial">60faf673-2cc5-463b-8d72-98943c8e4c5f</entry>
Nov 29 19:22:50 user nova-compute[75235]:       <entry name="uuid">60faf673-2cc5-463b-8d72-98943c8e4c5f</entry>
Nov 29 19:22:50 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:22:50 user nova-compute[75235]:     </system>
Nov 29 19:22:50 user nova-compute[75235]:   </sysinfo>
Nov 29 19:22:50 user nova-compute[75235]:   <os>
Nov 29 19:22:50 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:22:50 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:22:50 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:22:50 user nova-compute[75235]:   </os>
Nov 29 19:22:50 user nova-compute[75235]:   <features>
Nov 29 19:22:50 user nova-compute[75235]:     <acpi/>
Nov 29 19:22:50 user nova-compute[75235]:     <apic/>
Nov 29 19:22:50 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:22:50 user nova-compute[75235]:   </features>
Nov 29 19:22:50 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:22:50 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:22:50 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:22:50 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:22:50 user nova-compute[75235]:   </clock>
Nov 29 19:22:50 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:22:50 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:22:50 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:22:50 user nova-compute[75235]:   </cpu>
Nov 29 19:22:50 user nova-compute[75235]:   <devices>
Nov 29 19:22:50 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:22:50 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:22:50 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk"/>
Nov 29 19:22:50 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:22:50 user nova-compute[75235]:     </disk>
Nov 29 19:22:50 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:22:50 user nova-compute[75235]:       <mac address="fa:16:3e:10:54:cf"/>
Nov 29 19:22:50 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:22:50 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:22:50 user nova-compute[75235]:       <target dev="tap0d9e9572-5d"/>
Nov 29 19:22:50 user nova-compute[75235]:     </interface>
Nov 29 19:22:50 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:22:50 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/console.log" append="off"/>
Nov 29 19:22:50 user nova-compute[75235]:     </serial>
Nov 29 19:22:50 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:22:50 user nova-compute[75235]:     <video>
Nov 29 19:22:50 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:22:50 user nova-compute[75235]:     </video>
Nov 29 19:22:50 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:22:50 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:22:50 user nova-compute[75235]:     </rng>
Nov 29 19:22:50 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:22:50 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:22:50 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:22:50 user nova-compute[75235]:     </memballoon>
Nov 29 19:22:50 user nova-compute[75235]:   </devices>
Nov 29 19:22:50 user nova-compute[75235]: </domain>
Nov 29 19:22:50 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1288015214',display_name='tempest-VolumesSnapshotTestJSON-instance-1288015214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1288015214',id=42,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA7y1i+ggIgACD0j3fRIlEYHytKFjSdvks00fEHSY/x6NuhR0/h34AcbE9aN+P6QQYOT4kFpiXKjfNnI9LYBCoUZTI6GIlLBh6AyBlFZePVsrdNI8yySSwuOgB2fGiaiQ==',key_name='tempest-keypair-1198979514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ad88693560a465299e61e263c402de3',ramdisk_id='',reservation_id='r-m74oku0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1975532199',owner_user_name='tempest-VolumesSnapshotTestJSON-1975532199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aec9d4541474364baae470f90efe2ea',uuid=60faf673-2cc5-463b-8d72-98943c8e4c5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converting VIF {"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG os_vif [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '645d987c-2256-5cf9-b05f-a7f851f9ebe4', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d9e9572-5d, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d9e9572-5d, col_values=(('qos', UUID('32b588e8-e6f3-4fee-b7e2-f543384fd85a')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d9e9572-5d, col_values=(('external_ids', {'iface-id': '0d9e9572-5d93-4473-86ff-82a5cb1eaf32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:54:cf', 'vm-uuid': '60faf673-2cc5-463b-8d72-98943c8e4c5f'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:50 user nova-compute[75235]: INFO os_vif [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d')
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No VIF found with MAC fa:16:3e:10:54:cf, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updated VIF entry in instance network info cache for port 0d9e9572-5d93-4473-86ff-82a5cb1eaf32. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG nova.network.neutron [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updating instance_info_cache with network_info: [{"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:22:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-87e5cb30-5c8a-4b85-8e00-05e87f9f969a req-7600b4cb-8f1c-4835-9868-da531a0f8639 service nova] Releasing lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:22:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf41c626-35da-4288-aad2-e86a148b5713 req-b43f3a87-062c-4d68-b6a1-e78915165a8d service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf41c626-35da-4288-aad2-e86a148b5713 req-b43f3a87-062c-4d68-b6a1-e78915165a8d service nova] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf41c626-35da-4288-aad2-e86a148b5713 req-b43f3a87-062c-4d68-b6a1-e78915165a8d service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf41c626-35da-4288-aad2-e86a148b5713 req-b43f3a87-062c-4d68-b6a1-e78915165a8d service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf41c626-35da-4288-aad2-e86a148b5713 req-b43f3a87-062c-4d68-b6a1-e78915165a8d service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] No waiting events found dispatching network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:52 user nova-compute[75235]: WARNING nova.compute.manager [req-cf41c626-35da-4288-aad2-e86a148b5713 req-b43f3a87-062c-4d68-b6a1-e78915165a8d service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received unexpected event network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 for instance with vm_state building and task_state spawning.
Nov 29 19:22:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b019100-0e49-43ac-977a-8cca0880b316 req-1852d4f2-32ad-4d69-b3d3-edea37e8fb62 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b019100-0e49-43ac-977a-8cca0880b316 req-1852d4f2-32ad-4d69-b3d3-edea37e8fb62 service nova] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b019100-0e49-43ac-977a-8cca0880b316 req-1852d4f2-32ad-4d69-b3d3-edea37e8fb62 service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5b019100-0e49-43ac-977a-8cca0880b316 req-1852d4f2-32ad-4d69-b3d3-edea37e8fb62 service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-5b019100-0e49-43ac-977a-8cca0880b316 req-1852d4f2-32ad-4d69-b3d3-edea37e8fb62 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] No waiting events found dispatching network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:22:54 user nova-compute[75235]: WARNING nova.compute.manager [req-5b019100-0e49-43ac-977a-8cca0880b316 req-1852d4f2-32ad-4d69-b3d3-edea37e8fb62 service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received unexpected event network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 for instance with vm_state building and task_state spawning.
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:22:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Instance spawned successfully.
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:22:54 user nova-compute[75235]: INFO nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 29 19:22:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:22:54 user nova-compute[75235]: INFO nova.compute.manager [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Took 6.24 seconds to build instance.
Nov 29 19:22:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-9ddcea6c-0045-40cc-ab0f-2c597d97992b tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.333s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:22:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:22:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:23:05 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:23:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=24.731014251708984GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 6135576e-9c21-4d7c-b4f8-e829dd032690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 864ba3bb-968d-48a1-96d1-157a6f3feb18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 60faf673-2cc5-463b-8d72-98943c8e4c5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:23:11 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updating instance_info_cache with network_info: [{"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-c0628a53-2856-47c2-8b64-651c656f9d93" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:23:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-changed-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:22 user nova-compute[75235]: DEBUG nova.compute.manager [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Refreshing instance network info cache due to event network-changed-c86eb44c-3344-44e4-a188-7973dd3c7679. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:23:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] Acquiring lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:23:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] Acquired lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:23:22 user nova-compute[75235]: DEBUG nova.network.neutron [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Refreshing network info cache for port c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updated VIF entry in instance network info cache for port c86eb44c-3344-44e4-a188-7973dd3c7679. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updating instance_info_cache with network_info: [{"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3dfb886d-198a-47df-8e71-d6b9d4e069d4 req-1e61a41c-d8df-46d9-a66c-488b9c05fa4d service nova] Releasing lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG nova.objects.instance [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'flavor' on Instance uuid 6135576e-9c21-4d7c-b4f8-e829dd032690 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:23 user nova-compute[75235]: INFO nova.compute.manager [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Attaching volume 4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 to /dev/vdb
Nov 29 19:23:23 user nova-compute[75235]: DEBUG os_brick.utils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fdc9a9-d89e-469e-9df4-715f8bed7124]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101e555-b668-4b6d-a238-e69353ba4060]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd5b26d-c054-421e-8667-24bdbc7ce242]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec97c9e1-578d-4b43-9d4a-fc18f283aefa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:23:23 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:23:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[da43ea8d-fdda-4562-a5ac-85ee325a8322]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG os_brick.utils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:23:23 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updating existing volume attachment record: 4aba0938-d1e3-4f2a-bc4b-a6df7e030fad {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:23:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtcFeHVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:23:31 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:23:31 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:23:31 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3509d78c-51f7-4d60-bfbc-01d2bfc6ee0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:23:31 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0513c-71ee-4ff8-ab46-a5db74d475c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92] added
Nov 29 19:23:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51263e-fa59-4fff-a34a-728270a656d5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[12492302-8000-48fe-8670-158081098963]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtcFeHVR {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtcFeHVR" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee8d26f-d39e-4c41-96d9-ffb932fe310d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtcFeHVR'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6bcc73-be76-4710-bd60-51610756dba3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db40b3-955a-4266-8595-5cfd851abe21]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[747b18b1-b0d5-45a9-b615-ba4c1e755920]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260]
Nov 29 19:23:31 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260] successful.
Nov 29 19:23:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3557fb-d1f3-4fea-bf00-5432b5e38ffa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e6a58-b008-40cc-82fe-92ed3276ba7b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 (non-flash)
Nov 29 19:23:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[735d28d6-3328-4233-a5c2-01d38d0a499f]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtcFeHVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26434666261323034', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434666261323034', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG nova.objects.instance [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'flavor' on Instance uuid 6135576e-9c21-4d7c-b4f8-e829dd032690 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:23:32 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:23:32 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:23:32 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:23:32 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:23:32 user nova-compute[75235]:   <serial>4e6d28c5-9bc0-42fb-b30a-37d6cc509b92</serial>
Nov 29 19:23:32 user nova-compute[75235]: </disk>
Nov 29 19:23:32 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:23:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:23:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:23:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] No VIF found with MAC fa:16:3e:90:cb:7b, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:23:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-68295f5e-6363-4eb9-a389-77f8c1d5fb3e tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.562s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:34 user nova-compute[75235]: INFO nova.compute.manager [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Detaching volume 4e6d28c5-9bc0-42fb-b30a-37d6cc509b92
Nov 29 19:23:34 user nova-compute[75235]: INFO nova.virt.block_device [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Attempting to driver detach volume 4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 from mountpoint /dev/vdb
Nov 29 19:23:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Attempting to detach device vdb from instance 6135576e-9c21-4d7c-b4f8-e829dd032690 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:23:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:23:34 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:23:34 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:23:34 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:23:34 user nova-compute[75235]:   <serial>4e6d28c5-9bc0-42fb-b30a-37d6cc509b92</serial>
Nov 29 19:23:34 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:23:34 user nova-compute[75235]: </disk>
Nov 29 19:23:34 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:23:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully detached device vdb from instance 6135576e-9c21-4d7c-b4f8-e829dd032690 from the persistent domain config.
Nov 29 19:23:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6135576e-9c21-4d7c-b4f8-e829dd032690 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:23:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:23:34 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:23:34 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:23:34 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:23:34 user nova-compute[75235]:   <serial>4e6d28c5-9bc0-42fb-b30a-37d6cc509b92</serial>
Nov 29 19:23:34 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:23:34 user nova-compute[75235]: </disk>
Nov 29 19:23:34 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:23:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6135576e-9c21-4d7c-b4f8-e829dd032690 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:23:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing instance network info cache due to event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:52 user nova-compute[75235]: INFO nova.compute.manager [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Detaching volume 99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-changed-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Refreshing instance network info cache due to event network-changed-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] Acquiring lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] Acquired lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Refreshing network info cache for port dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:23:52 user nova-compute[75235]: INFO nova.virt.block_device [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Attempting to driver detach volume 99d16c9b-0e54-4707-a019-c87264a21e47 from mountpoint /dev/vdb
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Attempting to detach device vdb from instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:23:52 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:23:52 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:23:52 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:23:52 user nova-compute[75235]:   <serial>99d16c9b-0e54-4707-a019-c87264a21e47</serial>
Nov 29 19:23:52 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:23:52 user nova-compute[75235]: </disk>
Nov 29 19:23:52 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:23:52 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully detached device vdb from instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c from the persistent domain config.
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:23:52 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:23:52 user nova-compute[75235]:   <source dev="/dev/sdf"/>
Nov 29 19:23:52 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:23:52 user nova-compute[75235]:   <serial>99d16c9b-0e54-4707-a019-c87264a21e47</serial>
Nov 29 19:23:52 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:23:52 user nova-compute[75235]: </disk>
Nov 29 19:23:52 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updated VIF entry in instance network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-71cfcd95-87ce-43fd-b595-e032ac3eec5c req-41a60d47-46b5-48b7-88ef-eecf451d836b service nova] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:23:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:23:53 user nova-compute[75235]: DEBUG nova.network.neutron [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updated VIF entry in instance network info cache for port dc3904a1-c0f9-44f2-baf0-dd8b240d1b45. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:23:53 user nova-compute[75235]: DEBUG nova.network.neutron [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updating instance_info_cache with network_info: [{"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:53 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a6840cf3-2a44-437b-bbe9-3e9af9807a09 req-6853c70d-463c-463c-b804-cb36dcb0a531 service nova] Releasing lock "refresh_cache-f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing instance network info cache due to event network-changed-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] Acquiring lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] Acquired lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG nova.network.neutron [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Refreshing network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG nova.network.neutron [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updated VIF entry in instance network info cache for port 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG nova.network.neutron [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [{"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-36f9d9f9-8562-4ef3-aec9-5c20d5bc5656 req-dbd976ad-9110-4da4-b7fa-8267af1dd784 service nova] Releasing lock "refresh_cache-87f07af2-b1c8-47cd-be42-786dd4ee8f2c" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:23:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6135576e-9c21-4d7c-b4f8-e829dd032690 is timed out.
Nov 29 19:23:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully detached device vdb from instance 6135576e-9c21-4d7c-b4f8-e829dd032690 from the live domain config.
Nov 29 19:23:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtcFeHVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:23:55 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de00720c-b16c-41b1-81aa-48857ea055fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:23:55 user nova-compute[75235]: No targets found.
Nov 29 19:23:55 user nova-compute[75235]: iSNS:
Nov 29 19:23:55 user nova-compute[75235]: No targets found.
Nov 29 19:23:55 user nova-compute[75235]: STATIC:
Nov 29 19:23:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92
Nov 29 19:23:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:23:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:23:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:23:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:55 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:23:55 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:55 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:55 user nova-compute[75235]: FIRMWARE:
Nov 29 19:23:55 user nova-compute[75235]: No targets found.
Nov 29 19:23:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:23:55 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:23:55 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad464e5-2b04-4d81-9a85-aa83a7b96ba7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dad2867-a1cb-49a6-b4bd-2dda8c1c4a9e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 (non-flash)
Nov 29 19:23:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c74fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:55 user nova-compute[75235]: INFO nova.compute.manager [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Terminating instance
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8182fdeb-06da-40ca-900a-ad1498ad444a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c712362-d1f1-46b9-8fe0-a55a44caf238]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3890b0a8-8edf-487c-aafb-f8f837bbb7b4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[983acef8-b772-4723-9c8a-f1e4706511fc]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3541ad2-7de7-43fe-b786-41bc73217dd8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a89c7d-43d2-482e-825f-29501c1b5237]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260]
Nov 29 19:23:55 user nova-compute[75235]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92, portal: 172.16.0.220,3260] successful.
Nov 29 19:23:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6d28c5-9bc0-42fb-b30a-37d6cc509b92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1371eb83-2fc7-490e-800d-1f08d1e8f8bf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] <== disconnect_volume: return (337ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lazy-loading 'flavor' on Instance uuid f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Instance destroyed successfully.
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'resources' on Instance uuid 48a36fcc-48c0-4e84-ab7f-26518d4c57ca {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718067018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718067018',id=37,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-1r4jddyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:22:11Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=48a36fcc-48c0-4e84-ab7f-26518d4c57ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "address": "fa:16:3e:b1:b2:ad", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa7c083-ab", "ovs_interfaceid": "4fa7c083-ab1d-4cea-9491-8a975ac73015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_vif [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fa7c083-ab, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.compute.manager [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:23:56 user nova-compute[75235]: WARNING nova.compute.manager [req-55423858-3de0-44ad-ab5d-69f2961e1a4e req-8548e712-65fe-4c03-ad78-94c13769d28e service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state active and task_state deleting.
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:56 user nova-compute[75235]: INFO nova.compute.manager [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Attaching volume 2b2eb990-9248-40c5-b518-19d90bff5fe2 to /dev/vdb
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d57ad95c-1bb1-4aaf-9d40-6fb297eef3bd) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:23:56 user nova-compute[75235]: INFO os_vif [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:b2:ad,bridge_name='br-int',has_traffic_filtering=True,id=4fa7c083-ab1d-4cea-9491-8a975ac73015,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa7c083-ab')
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DAylsugJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:23:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dd4fd6-9ad7-4d18-bbd4-565ba6ece6a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:23:56 user nova-compute[75235]: No targets found.
Nov 29 19:23:56 user nova-compute[75235]: iSNS:
Nov 29 19:23:56 user nova-compute[75235]: No targets found.
Nov 29 19:23:56 user nova-compute[75235]: STATIC:
Nov 29 19:23:56 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:23:56 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:56 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:56 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb
Nov 29 19:23:56 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:56 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:56 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:23:56 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:56 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:56 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:23:56 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:23:56 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:23:56 user nova-compute[75235]: FIRMWARE:
Nov 29 19:23:56 user nova-compute[75235]: No targets found.
Nov 29 19:23:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:23:56 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:23:56 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.utils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0fd40-154f-4795-9ce0-17e4043a3e4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[12479475-018a-4a5b-a455-83878d914122]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4357c1ce-45d8-4148-b095-c7a43bd02564]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:56 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:56 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:56 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:23:56 user nova-compute[75235]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb (non-flash)
Nov 29 19:23:56 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:23:56 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:23:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56581285e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfed557-16af-4a46-8960-3344b24bbccc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3f1ea2-b9f2-4447-b61d-fa211c4c31a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3d4ebd-f188-4563-a1aa-035b9113f4ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888fd85-e80c-40eb-bced-3c3258891f2f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83aa05f-0f26-4d4a-9f03-2bbedbeb9936]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:23:56 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce2f83-8c58-4ec7-9fb1-a858362355ca]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.utils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updating existing volume attachment record: 83d561bc-5e14-4d85-94c4-e1a6ae3a27d3 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22edf0e-bc2b-4d9c-9ccd-20fa66b10645]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'flavor' on Instance uuid 6135576e-9c21-4d7c-b4f8-e829dd032690 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c14168-90a1-4039-8ed7-ba8d9c979c4e]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1d626cbb-6f99-41c8-a14c-1cf42d793421 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.021s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3236f618-59d4-4fa3-aca9-7ee03a8cacd0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[866fbe98-280f-4b68-a569-a65c26dda842]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260]
Nov 29 19:23:56 user nova-compute[75235]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb, portal: 172.16.0.220,3260] successful.
Nov 29 19:23:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d399a62f-5fe1-4c94-9fbd-d886263beffb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e640e89-de8c-4ac0-8f4c-bc98c9701463]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== disconnect_volume: return (446ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:23:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Deleting instance files /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca_del
Nov 29 19:23:56 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Deletion of /opt/stack/data/nova/instances/48a36fcc-48c0-4e84-ab7f-26518d4c57ca_del complete
Nov 29 19:23:56 user nova-compute[75235]: INFO nova.compute.manager [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 29 19:23:56 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:23:56 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:23:57 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:57 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Took 0.46 seconds to deallocate network for instance.
Nov 29 19:23:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-967e0d68-f915-4a9c-b5bf-124850d496da req-212fd1f9-6330-482e-8c4b-7b18a699fa31 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-deleted-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:57 user nova-compute[75235]: INFO nova.compute.manager [req-967e0d68-f915-4a9c-b5bf-124850d496da req-212fd1f9-6330-482e-8c4b-7b18a699fa31 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Neutron deleted interface 4fa7c083-ab1d-4cea-9491-8a975ac73015; detaching it from the instance and deleting it from the info cache
Nov 29 19:23:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-967e0d68-f915-4a9c-b5bf-124850d496da req-212fd1f9-6330-482e-8c4b-7b18a699fa31 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:23:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-967e0d68-f915-4a9c-b5bf-124850d496da req-212fd1f9-6330-482e-8c4b-7b18a699fa31 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Detach interface failed, port_id=4fa7c083-ab1d-4cea-9491-8a975ac73015, reason: Instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:23:58 user nova-compute[75235]: INFO nova.compute.manager [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Took 0.87 seconds to detach 1 volumes for instance.
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:23:58 user nova-compute[75235]: WARNING nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state deleted and task_state None.
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:23:58 user nova-compute[75235]: WARNING nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state deleted and task_state None.
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:23:58 user nova-compute[75235]: WARNING nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-unplugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state deleted and task_state None.
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Acquiring lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] No waiting events found dispatching network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:23:58 user nova-compute[75235]: WARNING nova.compute.manager [req-1df4a9b8-9dc9-4c5d-848e-181021b0842c req-2b8c4a34-ee41-462b-9b5d-dabeb0c8e683 service nova] [instance: 48a36fcc-48c0-4e84-ab7f-26518d4c57ca] Received unexpected event network-vif-plugged-4fa7c083-ab1d-4cea-9491-8a975ac73015 for instance with vm_state deleted and task_state None.
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:58 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Deleted allocations for instance 48a36fcc-48c0-4e84-ab7f-26518d4c57ca
Nov 29 19:23:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d978b7f4-59d8-4407-9613-e3c4ff549162 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "48a36fcc-48c0-4e84-ab7f-26518d4c57ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.494s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:23:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWLorws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:04 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[412cf239-edd8-4109-bc65-6ae1792f42f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:24:04 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a2e6ba-31b0-4d3e-a72d-64b2ebb2b5d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2] added
Nov 29 19:24:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[652c77de-f711-40a4-8f25-ef8dc4912288]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[14164536-4158-42f2-ac93-0ed15ff038a1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COWLorws {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v COWLorws" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a4e2f-1d87-458e-82cb-9b99c77cd97f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'COWLorws'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb2b87-a530-4ac1-9152-6ea78a0f2915]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e778056-753e-4fcc-bf47-242b8cefd23e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8b9ae-fdf4-44b5-85c9-5b231bc4302d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260]
Nov 29 19:24:04 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260] successful.
Nov 29 19:24:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1c53ad-8a87-45f3-834b-c31a161d75be]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80a9359-7476-4b41-8c03-54a48ea9093f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af87af6-a607-4d16-88b8-b49d1c3e7f87]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWLorws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-changed-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Refreshing instance network info cache due to event network-changed-8da32f1e-c2bc-43f9-842a-e65671964948. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] Acquiring lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] Acquired lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG nova.network.neutron [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Refreshing network info cache for port 8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:24:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updated VIF entry in instance network info cache for port 8da32f1e-c2bc-43f9-842a-e65671964948. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.network.neutron [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updating instance_info_cache with network_info: [{"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e5b793c1-91d8-43c2-8505-6ebb0d0d7d03 req-be07c992-d59b-4571-a262-800762d9e05c service nova] Releasing lock "refresh_cache-864ba3bb-968d-48a1-96d1-157a6f3feb18" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23234623531396139', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234623531396139', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lazy-loading 'flavor' on Instance uuid f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:24:05 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:24:05 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:24:05 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:24:05 user nova-compute[75235]:   <serial>2b2eb990-9248-40c5-b518-19d90bff5fe2</serial>
Nov 29 19:24:05 user nova-compute[75235]: </disk>
Nov 29 19:24:05 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] No VIF found with MAC fa:16:3e:cb:c4:0c, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:24:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3fd05238-0ea2-4fe9-a355-842c40519624 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.840s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:24:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:07 user nova-compute[75235]: INFO nova.compute.manager [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Detaching volume 2b2eb990-9248-40c5-b518-19d90bff5fe2
Nov 29 19:24:07 user nova-compute[75235]: INFO nova.virt.block_device [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Attempting to driver detach volume 2b2eb990-9248-40c5-b518-19d90bff5fe2 from mountpoint /dev/vdb
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Attempting to detach device vdb from instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:24:07 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:24:07 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:24:07 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:24:07 user nova-compute[75235]:   <serial>2b2eb990-9248-40c5-b518-19d90bff5fe2</serial>
Nov 29 19:24:07 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:24:07 user nova-compute[75235]: </disk>
Nov 29 19:24:07 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:24:07 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Successfully detached device vdb from instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 from the persistent domain config.
Nov 29 19:24:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:24:07 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:24:07 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:24:07 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:24:07 user nova-compute[75235]:   <serial>2b2eb990-9248-40c5-b518-19d90bff5fe2</serial>
Nov 29 19:24:07 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:24:07 user nova-compute[75235]: </disk>
Nov 29 19:24:07 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:24:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:24:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=24.701038360595703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 6135576e-9c21-4d7c-b4f8-e829dd032690 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 864ba3bb-968d-48a1-96d1-157a6f3feb18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 60faf673-2cc5-463b-8d72-98943c8e4c5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:24:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:24:12 user nova-compute[75235]: INFO nova.compute.claims [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Claim successful on node user
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:24:12 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:24:12 user nova-compute[75235]: INFO nova.virt.block_device [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Booting with volume snapshot f4df5524-4363-4363-820b-6fe863106124 at /dev/vda
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.policy [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20d52323a014526b5ebd121d637f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e15c428b2f43b9a2e5850370c4f938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:24:12 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c is timed out.
Nov 29 19:24:12 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully detached device vdb from instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c from the live domain config.
Nov 29 19:24:12 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGmPIFnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:12 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa20d3d-1481-4298-85bc-63840a5e992c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:24:13 user nova-compute[75235]: No targets found.
Nov 29 19:24:13 user nova-compute[75235]: iSNS:
Nov 29 19:24:13 user nova-compute[75235]: No targets found.
Nov 29 19:24:13 user nova-compute[75235]: STATIC:
Nov 29 19:24:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47
Nov 29 19:24:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2
Nov 29 19:24:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:24:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:13 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:24:13 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:13 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:13 user nova-compute[75235]: FIRMWARE:
Nov 29 19:24:13 user nova-compute[75235]: No targets found.
Nov 29 19:24:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:24:13 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:24:13 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700c592-373c-4ec9-8ec4-e5bb99d44fd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[214664db-7d76-4fff-86c0-c77e5fbbba5c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56505165f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47'): ({'sdf'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Removing single pathed devices sdf {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6620ab57-f55f-4ae1-8895-6fc448cd1e2d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3317d7-99a0-44e5-af1c-f839727cb6f5]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Flushing IO for device /dev/sdf {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f631856-aedc-4965-abe1-1b6b12f9d38e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe5593-63d6-47b4-bd17-890507628dae]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] SCSI volumes sdf have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[def11a14-45f4-4dbb-994d-45dc84896edc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ead7fee-459e-4b16-81d4-3a707ba27b09]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260]
Nov 29 19:24:13 user nova-compute[75235]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47, portal: 172.16.0.220,3260] successful.
Nov 29 19:24:13 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d16c9b-0e54-4707-a019-c87264a21e47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c0d563-0c0d-416f-a795-f184e2a1537e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] <== disconnect_volume: return (339ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Successfully created port: eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:24:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [{"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-b53656ac-d97b-4845-9be5-04f96f00d07e" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'flavor' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Successfully updated port: eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquired lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e63d2b2-dade-4b79-94c0-8676c077f583 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.860s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-changed-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Refreshing instance network info cache due to event network-changed-eb14eaa9-33df-477e-a324-0f79725fdcb2. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] Acquiring lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updating instance_info_cache with network_info: [{"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Releasing lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Instance network_info: |[{"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] Acquired lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Refreshing network info cache for port eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updated VIF entry in instance network info cache for port eb14eaa9-33df-477e-a324-0f79725fdcb2. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG nova.network.neutron [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updating instance_info_cache with network_info: [{"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-41365659-9b4d-416e-9f21-5698c17abe8d req-a393cd06-6fd4-420d-8205-dfd5cbadcd98 service nova] Releasing lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:24:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:24:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG os_brick.utils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[770a2738-c15d-4cb9-81fd-02f2982b6807]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed4cd4d-ca79-40b7-96ef-e1ddb4682194]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7356343-5d41-4214-8d27-df2a2746800a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[63417a63-faca-4e9e-b968-484f3b14de92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:24:18 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:24:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b7dd8-9248-4e54-8f22-67c52a762908]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG os_brick.utils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:18 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updating existing volume attachment record: cb798ada-2056-41e5-85f0-f959f7a08b09 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:24:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-changed-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Refreshing instance network info cache due to event network-changed-c86eb44c-3344-44e4-a188-7973dd3c7679. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] Acquiring lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] Acquired lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Refreshing network info cache for port c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:25 user nova-compute[75235]: INFO nova.compute.manager [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Terminating instance
Nov 29 19:24:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updated VIF entry in instance network info cache for port c86eb44c-3344-44e4-a188-7973dd3c7679. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updating instance_info_cache with network_info: [{"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-95af1075-707c-431c-9fa6-603afc82d7bc req-82fbc197-1e20-42a9-a247-aaca87b933e8 service nova] Releasing lock "refresh_cache-6135576e-9c21-4d7c-b4f8-e829dd032690" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:24:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Instance destroyed successfully.
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.objects.instance [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'resources' on Instance uuid 6135576e-9c21-4d7c-b4f8-e829dd032690 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1262927131',display_name='tempest-TestStampPattern-server-1262927131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1262927131',id=39,image_ref='83a51a05-aba9-4d12-9159-6dfc4b7f8d3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn3xVYo+E0cU9Uy/fU7QjtKHhvF/x6NUW0tu+5nR3jqZ7TBsLl5Pf/NwyWXbpCskpo3RJCjL48V0UetcFJscnJorQKUz2IcUOa+ov7qXiZkRoF+eVV193Dgm56Xr3HCCw==',key_name='tempest-TestStampPattern-1606459428',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:21:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',ramdisk_id='',reservation_id='r-zhals5xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a54d682f-41ac-4ab4-b622-3659d507016b',image_min_disk='1',image_min_ram='0',image_owner_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',image_owner_project_name='tempest-TestStampPattern-2015071819',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2015071819-project-member',image_user_id='2ded506037834e6783ff09742a34fca0',owner_project_name='tempest-TestStampPattern-2015071819',owner_user_name='tempest-TestStampPattern-2015071819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:21:39Z,user_data=None,user_id='2ded506037834e6783ff09742a34fca0',uuid=6135576e-9c21-4d7c-b4f8-e829dd032690,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converting VIF {"id": "c86eb44c-3344-44e4-a188-7973dd3c7679", "address": "fa:16:3e:90:cb:7b", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86eb44c-33", "ovs_interfaceid": "c86eb44c-3344-44e4-a188-7973dd3c7679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_vif [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc86eb44c-33, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4beb3f2-28ac-4b59-9424-dac90b13d49c) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:26 user nova-compute[75235]: INFO os_vif [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:cb:7b,bridge_name='br-int',has_traffic_filtering=True,id=c86eb44c-3344-44e4-a188-7973dd3c7679,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86eb44c-33')
Nov 29 19:24:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Deleting instance files /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690_del
Nov 29 19:24:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Deletion of /opt/stack/data/nova/instances/6135576e-9c21-4d7c-b4f8-e829dd032690_del complete
Nov 29 19:24:26 user nova-compute[75235]: INFO nova.compute.manager [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:24:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Creating image(s)
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Ensure instance console log exists: /opt/stack/data/nova/instances/868639e7-8048-4f4d-b3b2-53834cd3dbd8/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Start _get_guest_xml network_info=[{"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T19:24:06Z,direct_url=<?>,disk_format='qcow2',id=cddbe5f6-1f0a-46e1-a3ed-c3352f050592,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-129890229',owner='87e15c428b2f43b9a2e5850370c4f938',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T19:24:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'cb798ada-2056-41e5-85f0-f959f7a08b09', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efQzotCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '868639e7-8048-4f4d-b3b2-53834cd3dbd8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f246c860-a181-4f34-8efa-1a4c8aa01307', 'serial': 'f246c860-a181-4f34-8efa-1a4c8aa01307'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:24:26 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:24:26 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T19:24:06Z,direct_url=<?>,disk_format='qcow2',id=cddbe5f6-1f0a-46e1-a3ed-c3352f050592,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-129890229',owner='87e15c428b2f43b9a2e5850370c4f938',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T19:24:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efQzotCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:26 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:26 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:26 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba31c2-457a-459e-9509-171428dfb982]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:24:26 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb795c-35ca-49d5-b2ba-c54b950a19d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307] added
Nov 29 19:24:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c58e2da-e512-4722-8db0-646a0ab9783d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Took 0.49 seconds to deallocate network for instance.
Nov 29 19:24:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-b1aae99f-06a6-4a86-baca-02efbc4a85d4 req-365536fa-d2ad-4030-b44d-d10cd6aea13e service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-vif-deleted-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac20d2-0ecb-4d6d-a4de-9e55ccac3c42]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efQzotCg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efQzotCg" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fdf6c5-fead-4cb2-88aa-2645471fd320]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'efQzotCg'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[abda0594-17e3-40a2-9bca-d8c2b950473c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c9e78-99e0-466e-af18-5d5fdc48c3bb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[704255ec-5a9c-480e-921e-ce7e10736c77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260]
Nov 29 19:24:26 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260] successful.
Nov 29 19:24:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c936444-55d7-423b-9321-689385952807]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[071acb12-1b8b-4c1d-bf7a-d96c1ba04c84]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:26 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d492d04-af2c-4dd9-bcfc-173f9532257d]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:24:26 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efQzotCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:27 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Deleted allocations for instance 6135576e-9c21-4d7c-b4f8-e829dd032690
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-vif-unplugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] No waiting events found dispatching network-vif-unplugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:27 user nova-compute[75235]: WARNING nova.compute.manager [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received unexpected event network-vif-unplugged-c86eb44c-3344-44e4-a188-7973dd3c7679 for instance with vm_state deleted and task_state None.
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received event network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] Acquiring lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] No waiting events found dispatching network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:27 user nova-compute[75235]: WARNING nova.compute.manager [req-43b67e1b-130d-4d11-a5e2-07d6afd77a7f req-c682d5ca-ae7c-4ff5-9bac-30012fa398f8 service nova] [instance: 6135576e-9c21-4d7c-b4f8-e829dd032690] Received unexpected event network-vif-plugged-c86eb44c-3344-44e4-a188-7973dd3c7679 for instance with vm_state deleted and task_state None.
Nov 29 19:24:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-1167fd16-186b-4fca-8cab-2eaa282f995d tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "6135576e-9c21-4d7c-b4f8-e829dd032690" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26263386334653364', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263386334653364', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-775136502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-775136502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-775136502',id=43,image_ref='cddbe5f6-1f0a-46e1-a3ed-c3352f050592',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjKMdfaDdp7cyBUhbksofzQx5K7ONOqHtxxLqIPZr73kJkh9zVc2kkr21nFAzQcb2XxkQxUj2oYX/V9C0HWKqDE6wTWsjuEjwmyB/t0qf9+k3mcwYNRU/R+aPaC1j1X9g==',key_name='tempest-keypair-1518402171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-yocbh437',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-656128499',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20d52323a014526b5ebd121d637f4c4',uuid=868639e7-8048-4f4d-b3b2-53834cd3dbd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'pci_devices' on Instance uuid 868639e7-8048-4f4d-b3b2-53834cd3dbd8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:24:27 user nova-compute[75235]:   <uuid>868639e7-8048-4f4d-b3b2-53834cd3dbd8</uuid>
Nov 29 19:24:27 user nova-compute[75235]:   <name>instance-0000002b</name>
Nov 29 19:24:27 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:24:27 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:24:27 user nova-compute[75235]:   <metadata>
Nov 29 19:24:27 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:24:27 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:24:27 user nova-compute[75235]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-775136502</nova:name>
Nov 29 19:24:27 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:24:26</nova:creationTime>
Nov 29 19:24:27 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:24:27 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:24:27 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:24:27 user nova-compute[75235]:       <nova:owner>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:user uuid="f20d52323a014526b5ebd121d637f4c4">tempest-TestVolumeBootPattern-656128499-project-member</nova:user>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:project uuid="87e15c428b2f43b9a2e5850370c4f938">tempest-TestVolumeBootPattern-656128499</nova:project>
Nov 29 19:24:27 user nova-compute[75235]:       </nova:owner>
Nov 29 19:24:27 user nova-compute[75235]:       <nova:root type="image" uuid="cddbe5f6-1f0a-46e1-a3ed-c3352f050592"/>
Nov 29 19:24:27 user nova-compute[75235]:       <nova:ports>
Nov 29 19:24:27 user nova-compute[75235]:         <nova:port uuid="eb14eaa9-33df-477e-a324-0f79725fdcb2">
Nov 29 19:24:27 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 19:24:27 user nova-compute[75235]:         </nova:port>
Nov 29 19:24:27 user nova-compute[75235]:       </nova:ports>
Nov 29 19:24:27 user nova-compute[75235]:     </nova:instance>
Nov 29 19:24:27 user nova-compute[75235]:   </metadata>
Nov 29 19:24:27 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:24:27 user nova-compute[75235]:     <system>
Nov 29 19:24:27 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:24:27 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:24:27 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:24:27 user nova-compute[75235]:       <entry name="serial">868639e7-8048-4f4d-b3b2-53834cd3dbd8</entry>
Nov 29 19:24:27 user nova-compute[75235]:       <entry name="uuid">868639e7-8048-4f4d-b3b2-53834cd3dbd8</entry>
Nov 29 19:24:27 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:24:27 user nova-compute[75235]:     </system>
Nov 29 19:24:27 user nova-compute[75235]:   </sysinfo>
Nov 29 19:24:27 user nova-compute[75235]:   <os>
Nov 29 19:24:27 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:24:27 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:24:27 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:24:27 user nova-compute[75235]:   </os>
Nov 29 19:24:27 user nova-compute[75235]:   <features>
Nov 29 19:24:27 user nova-compute[75235]:     <acpi/>
Nov 29 19:24:27 user nova-compute[75235]:     <apic/>
Nov 29 19:24:27 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:24:27 user nova-compute[75235]:   </features>
Nov 29 19:24:27 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:24:27 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:24:27 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:24:27 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:24:27 user nova-compute[75235]:   </clock>
Nov 29 19:24:27 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:24:27 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:24:27 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:24:27 user nova-compute[75235]:   </cpu>
Nov 29 19:24:27 user nova-compute[75235]:   <devices>
Nov 29 19:24:27 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:24:27 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:24:27 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:24:27 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:24:27 user nova-compute[75235]:       <serial>f246c860-a181-4f34-8efa-1a4c8aa01307</serial>
Nov 29 19:24:27 user nova-compute[75235]:     </disk>
Nov 29 19:24:27 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:24:27 user nova-compute[75235]:       <mac address="fa:16:3e:5e:76:e4"/>
Nov 29 19:24:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:24:27 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:24:27 user nova-compute[75235]:       <target dev="tapeb14eaa9-33"/>
Nov 29 19:24:27 user nova-compute[75235]:     </interface>
Nov 29 19:24:27 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:24:27 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/868639e7-8048-4f4d-b3b2-53834cd3dbd8/console.log" append="off"/>
Nov 29 19:24:27 user nova-compute[75235]:     </serial>
Nov 29 19:24:27 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:24:27 user nova-compute[75235]:     <video>
Nov 29 19:24:27 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:24:27 user nova-compute[75235]:     </video>
Nov 29 19:24:27 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:24:27 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:24:27 user nova-compute[75235]:     </rng>
Nov 29 19:24:27 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:24:27 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:24:27 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:24:27 user nova-compute[75235]:     </memballoon>
Nov 29 19:24:27 user nova-compute[75235]:   </devices>
Nov 29 19:24:27 user nova-compute[75235]: </domain>
Nov 29 19:24:27 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-775136502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-775136502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-775136502',id=43,image_ref='cddbe5f6-1f0a-46e1-a3ed-c3352f050592',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjKMdfaDdp7cyBUhbksofzQx5K7ONOqHtxxLqIPZr73kJkh9zVc2kkr21nFAzQcb2XxkQxUj2oYX/V9C0HWKqDE6wTWsjuEjwmyB/t0qf9+k3mcwYNRU/R+aPaC1j1X9g==',key_name='tempest-keypair-1518402171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-yocbh437',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-656128499',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20d52323a014526b5ebd121d637f4c4',uuid=868639e7-8048-4f4d-b3b2-53834cd3dbd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG os_vif [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68f9d257-09cb-5543-812f-37b3d15d8bda', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb14eaa9-33, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb14eaa9-33, col_values=(('qos', UUID('347d5560-8375-429c-845d-bd3f24b9648a')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb14eaa9-33, col_values=(('external_ids', {'iface-id': 'eb14eaa9-33df-477e-a324-0f79725fdcb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:76:e4', 'vm-uuid': '868639e7-8048-4f4d-b3b2-53834cd3dbd8'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:24:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:27 user nova-compute[75235]: INFO os_vif [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33')
Nov 29 19:24:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No VIF found with MAC fa:16:3e:5e:76:e4, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:24:28 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 is timed out.
Nov 29 19:24:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Successfully detached device vdb from instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 from the live domain config.
Nov 29 19:24:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'COWLorws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:28 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e040b-93d5-4d16-8139-84e801e42b92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:24:28 user nova-compute[75235]: No targets found.
Nov 29 19:24:28 user nova-compute[75235]: iSNS:
Nov 29 19:24:28 user nova-compute[75235]: No targets found.
Nov 29 19:24:28 user nova-compute[75235]: STATIC:
Nov 29 19:24:28 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2
Nov 29 19:24:28 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:28 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:28 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307
Nov 29 19:24:28 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:28 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:28 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:24:28 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:28 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:28 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:24:28 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:24:28 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:24:28 user nova-compute[75235]: FIRMWARE:
Nov 29 19:24:28 user nova-compute[75235]: No targets found.
Nov 29 19:24:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:24:28 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:24:28 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a89567-927f-474d-abb2-5a64e0c2d03d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41f11f3-923c-4974-86ec-c7a42f16d2bd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c70a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03bfdfe-428a-471e-abc0-b237031e1c08]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843e20f-ace8-41ee-bba6-4f719dc713cf]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b85b07-7a1a-4f07-a358-275047de55ad]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8f2b3-115b-4300-8a9b-b2618c68ffec]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed66a1-629e-48b9-ac35-4435f810d92c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a55f00d-79d7-46af-a17a-ed8987cd0ed5]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260]
Nov 29 19:24:28 user nova-compute[75235]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2, portal: 172.16.0.220,3260] successful.
Nov 29 19:24:28 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2eb990-9248-40c5-b518-19d90bff5fe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0664d90d-e705-4bfc-b282-9b862f00a492]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] <== disconnect_volume: return (303ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lazy-loading 'flavor' on Instance uuid f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f18fd519-0bfa-40b6-b592-072af88d033d tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG nova.compute.manager [req-64bf31dd-e7b7-4599-8115-92a81c33edf6 req-cf81fbdb-2410-4364-8a40-9337f85af8e4 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-64bf31dd-e7b7-4599-8115-92a81c33edf6 req-cf81fbdb-2410-4364-8a40-9337f85af8e4 service nova] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-64bf31dd-e7b7-4599-8115-92a81c33edf6 req-cf81fbdb-2410-4364-8a40-9337f85af8e4 service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-64bf31dd-e7b7-4599-8115-92a81c33edf6 req-cf81fbdb-2410-4364-8a40-9337f85af8e4 service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:29 user nova-compute[75235]: DEBUG nova.compute.manager [req-64bf31dd-e7b7-4599-8115-92a81c33edf6 req-cf81fbdb-2410-4364-8a40-9337f85af8e4 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] No waiting events found dispatching network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:29 user nova-compute[75235]: WARNING nova.compute.manager [req-64bf31dd-e7b7-4599-8115-92a81c33edf6 req-cf81fbdb-2410-4364-8a40-9337f85af8e4 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received unexpected event network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 for instance with vm_state building and task_state spawning.
Nov 29 19:24:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:24:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Instance spawned successfully.
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:24:31 user nova-compute[75235]: INFO nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:24:31 user nova-compute[75235]: INFO nova.compute.manager [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Took 19.24 seconds to build instance.
Nov 29 19:24:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b869e4b4-2f0d-48ed-9f1f-2c3c45923c65 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.338s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-9a52c22c-74b1-4b9d-8b47-29f4c205ed93 req-721252d5-a889-4d66-9d03-2555596ced6d service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9a52c22c-74b1-4b9d-8b47-29f4c205ed93 req-721252d5-a889-4d66-9d03-2555596ced6d service nova] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9a52c22c-74b1-4b9d-8b47-29f4c205ed93 req-721252d5-a889-4d66-9d03-2555596ced6d service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9a52c22c-74b1-4b9d-8b47-29f4c205ed93 req-721252d5-a889-4d66-9d03-2555596ced6d service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-9a52c22c-74b1-4b9d-8b47-29f4c205ed93 req-721252d5-a889-4d66-9d03-2555596ced6d service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] No waiting events found dispatching network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:31 user nova-compute[75235]: WARNING nova.compute.manager [req-9a52c22c-74b1-4b9d-8b47-29f4c205ed93 req-721252d5-a889-4d66-9d03-2555596ced6d service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received unexpected event network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 for instance with vm_state active and task_state None.
Nov 29 19:24:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-changed-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Refreshing instance network info cache due to event network-changed-0d9e9572-5d93-4473-86ff-82a5cb1eaf32. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] Acquiring lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] Acquired lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Refreshing network info cache for port 0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'flavor' on Instance uuid 60faf673-2cc5-463b-8d72-98943c8e4c5f {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Ignoring supplied device name: /dev/vdb
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:39 user nova-compute[75235]: INFO nova.compute.manager [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Attaching volume 5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 to /dev/vdb
Nov 29 19:24:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updated VIF entry in instance network info cache for port 0d9e9572-5d93-4473-86ff-82a5cb1eaf32. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updating instance_info_cache with network_info: [{"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6f9406db-95fe-497d-8bdb-177a159d44f2 req-80cc67c6-9195-4a42-b6a8-b968c7ef403c service nova] Releasing lock "refresh_cache-60faf673-2cc5-463b-8d72-98943c8e4c5f" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG os_brick.utils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5bfbd-c3d6-4dd6-89b4-49876a3c7a25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a637c-1a55-483c-9165-3ed63888a6b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da81aa6-49a1-4a13-9da5-0250d3613921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7805a9-80a6-41a6-b7bd-1a51f270ebde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:24:40 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:24:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9f587-ae78-4bfa-ae0c-e5a8af01e53b]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG os_brick.utils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:40 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updating existing volume attachment record: 3d043bed-0d0f-49db-82b0-467bab00d46b {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:42 user nova-compute[75235]: INFO nova.compute.manager [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Terminating instance
Nov 29 19:24:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-5899a93c-15fb-49ae-8b36-e3e4d3b1ddd2 req-ea9eaf14-c07f-4a68-a4e1-fa8e2ec0ac6f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5899a93c-15fb-49ae-8b36-e3e4d3b1ddd2 req-ea9eaf14-c07f-4a68-a4e1-fa8e2ec0ac6f service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5899a93c-15fb-49ae-8b36-e3e4d3b1ddd2 req-ea9eaf14-c07f-4a68-a4e1-fa8e2ec0ac6f service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5899a93c-15fb-49ae-8b36-e3e4d3b1ddd2 req-ea9eaf14-c07f-4a68-a4e1-fa8e2ec0ac6f service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-5899a93c-15fb-49ae-8b36-e3e4d3b1ddd2 req-ea9eaf14-c07f-4a68-a4e1-fa8e2ec0ac6f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-5899a93c-15fb-49ae-8b36-e3e4d3b1ddd2 req-ea9eaf14-c07f-4a68-a4e1-fa8e2ec0ac6f service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-unplugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Instance destroyed successfully.
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.objects.instance [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'resources' on Instance uuid 87f07af2-b1c8-47cd-be42-786dd4ee8f2c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-882513022',display_name='tempest-ServerRescueNegativeTestJSON-server-882513022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-882513022',id=35,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL4pdw6IxotoOWuh3YJnAWGaYdR2hnd7TFyyshEjvsUyltlIzZHO7qD0suc5S1bneaKKS89VqCKW2RuVN5J6i2ZkaTDeUvb7RLp5hgvfOGmV5Og0dGHAi8IamaCRLJ12Q==',key_name='tempest-keypair-1426874437',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-6qa0hs2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b09701817c0147aca7432e1329b82300',uuid=87f07af2-b1c8-47cd-be42-786dd4ee8f2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "address": "fa:16:3e:b5:d3:6c", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51fc0d05-ce", "ovs_interfaceid": "51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG os_vif [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51fc0d05-ce, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229188e1-a655-47fa-8cfc-793aa6ea234f) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:24:43 user nova-compute[75235]: INFO os_vif [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:d3:6c,bridge_name='br-int',has_traffic_filtering=True,id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51fc0d05-ce')
Nov 29 19:24:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Deleting instance files /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c_del
Nov 29 19:24:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Deletion of /opt/stack/data/nova/instances/87f07af2-b1c8-47cd-be42-786dd4ee8f2c_del complete
Nov 29 19:24:43 user nova-compute[75235]: INFO nova.compute.manager [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 19:24:43 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:24:43 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:44 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Took 0.70 seconds to deallocate network for instance.
Nov 29 19:24:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-a3cf497f-fa32-4b8d-bf76-d0cb5994e875 req-11ea28ca-97ec-4b06-86d7-e10850c8121c service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-deleted-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:44 user nova-compute[75235]: INFO nova.compute.manager [req-a3cf497f-fa32-4b8d-bf76-d0cb5994e875 req-11ea28ca-97ec-4b06-86d7-e10850c8121c service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Neutron deleted interface 51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c; detaching it from the instance and deleting it from the info cache
Nov 29 19:24:44 user nova-compute[75235]: DEBUG nova.network.neutron [req-a3cf497f-fa32-4b8d-bf76-d0cb5994e875 req-11ea28ca-97ec-4b06-86d7-e10850c8121c service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-a3cf497f-fa32-4b8d-bf76-d0cb5994e875 req-11ea28ca-97ec-4b06-86d7-e10850c8121c service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Detach interface failed, port_id=51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c, reason: Instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:44 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Deleted allocations for instance 87f07af2-b1c8-47cd-be42-786dd4ee8f2c
Nov 29 19:24:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-75aa3a15-bf40-4582-8ff2-7975dbcfef78 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.109s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-35a4e42e-dd44-4ba7-9210-59fad74d7345 req-664cb369-0a1b-4457-a74f-532ff6eac7b7 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-35a4e42e-dd44-4ba7-9210-59fad74d7345 req-664cb369-0a1b-4457-a74f-532ff6eac7b7 service nova] Acquiring lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-35a4e42e-dd44-4ba7-9210-59fad74d7345 req-664cb369-0a1b-4457-a74f-532ff6eac7b7 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-35a4e42e-dd44-4ba7-9210-59fad74d7345 req-664cb369-0a1b-4457-a74f-532ff6eac7b7 service nova] Lock "87f07af2-b1c8-47cd-be42-786dd4ee8f2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-35a4e42e-dd44-4ba7-9210-59fad74d7345 req-664cb369-0a1b-4457-a74f-532ff6eac7b7 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] No waiting events found dispatching network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:45 user nova-compute[75235]: WARNING nova.compute.manager [req-35a4e42e-dd44-4ba7-9210-59fad74d7345 req-664cb369-0a1b-4457-a74f-532ff6eac7b7 service nova] [instance: 87f07af2-b1c8-47cd-be42-786dd4ee8f2c] Received unexpected event network-vif-plugged-51fc0d05-ce9f-4b11-9aeb-e3a5c44dfa3c for instance with vm_state deleted and task_state None.
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:45 user nova-compute[75235]: INFO nova.compute.manager [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Terminating instance
Nov 29 19:24:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Instance destroyed successfully.
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'resources' on Instance uuid 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-974024086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-974024086',id=33,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:15:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-sjr64mr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:17:20Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "35a1b666-5951-4075-81f5-96cae92d02d3", "address": "fa:16:3e:59:61:51", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35a1b666-59", "ovs_interfaceid": "35a1b666-5951-4075-81f5-96cae92d02d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG os_vif [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35a1b666-59, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53e89f54-6a59-4451-b870-12e58cfa2b49) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:46 user nova-compute[75235]: INFO os_vif [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:61:51,bridge_name='br-int',has_traffic_filtering=True,id=35a1b666-5951-4075-81f5-96cae92d02d3,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35a1b666-59')
Nov 29 19:24:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Deleting instance files /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a_del
Nov 29 19:24:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Deletion of /opt/stack/data/nova/instances/04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a_del complete
Nov 29 19:24:46 user nova-compute[75235]: INFO nova.compute.manager [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 19:24:46 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-21bcd34b-15e6-450f-9ad4-1b4a4b9555ca req-48d5b10c-59ac-4103-aea3-d0df6d43c431 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-vif-unplugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-21bcd34b-15e6-450f-9ad4-1b4a4b9555ca req-48d5b10c-59ac-4103-aea3-d0df6d43c431 service nova] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-21bcd34b-15e6-450f-9ad4-1b4a4b9555ca req-48d5b10c-59ac-4103-aea3-d0df6d43c431 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-21bcd34b-15e6-450f-9ad4-1b4a4b9555ca req-48d5b10c-59ac-4103-aea3-d0df6d43c431 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-21bcd34b-15e6-450f-9ad4-1b4a4b9555ca req-48d5b10c-59ac-4103-aea3-d0df6d43c431 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] No waiting events found dispatching network-vif-unplugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:46 user nova-compute[75235]: DEBUG nova.compute.manager [req-21bcd34b-15e6-450f-9ad4-1b4a4b9555ca req-48d5b10c-59ac-4103-aea3-d0df6d43c431 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-vif-unplugged-35a1b666-5951-4075-81f5-96cae92d02d3 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:24:47 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Took 0.54 seconds to deallocate network for instance.
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:47 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Deleted allocations for instance 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d80ca4bc-501c-4b4d-860d-40386759406f tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.721s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeSrzUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:24:47 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:47 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:24:47 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ed6ec-d2f9-4b6b-b9ea-d4d824060b71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:24:47 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[928f7a72-0603-450e-a4dc-eb89cb997531]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5] added
Nov 29 19:24:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2d2945-2eef-4204-9fb7-f37c91a1a443]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3758d782-c140-43db-8847-7039604e91e6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZeSrzUwj {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZeSrzUwj" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec53216d-7be2-4a8c-bd7c-d681920f6e83]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZeSrzUwj'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4057a54-ce61-465a-8fe6-36f661777d59]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc20038-21a2-47e7-b05b-8c034160238c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:47 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:47 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:47 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:47 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:47 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:47 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a429e2fc-5135-4efb-ae57-cb3707ca6579]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260]
Nov 29 19:24:48 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260] successful.
Nov 29 19:24:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc66446-a6a4-46ef-af1e-be6371833957]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7976b5-2cd7-4a8f-b88b-727c4b8c2015]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 (non-flash)
Nov 29 19:24:48 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c0992-dba7-42e0-825a-506235a4176b]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] Acquiring lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] Lock "04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] No waiting events found dispatching network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:24:48 user nova-compute[75235]: WARNING nova.compute.manager [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received unexpected event network-vif-plugged-35a1b666-5951-4075-81f5-96cae92d02d3 for instance with vm_state deleted and task_state None.
Nov 29 19:24:48 user nova-compute[75235]: DEBUG nova.compute.manager [req-a5bc6a47-6ef4-4e2e-a1b4-77a90c4111e4 req-909b53ca-64ab-4b3f-a796-14d98f9c2306 service nova] [instance: 04ce39b7-d4ac-4829-83f6-1f8bb0e35f2a] Received event network-vif-deleted-35a1b666-5951-4075-81f5-96cae92d02d3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeSrzUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23366373364383138', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366373364383138', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'flavor' on Instance uuid 60faf673-2cc5-463b-8d72-98943c8e4c5f {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:24:49 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:24:49 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:24:49 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:24:49 user nova-compute[75235]:   <serial>5b1a74c9-e2b6-4687-b55b-c9c390a89aa5</serial>
Nov 29 19:24:49 user nova-compute[75235]: </disk>
Nov 29 19:24:49 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No VIF found with MAC fa:16:3e:10:54:cf, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f06a50f4-9aad-44ca-ba4d-b8c590090f05 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.810s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:24:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:24:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:02 user nova-compute[75235]: INFO nova.compute.manager [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Terminating instance
Nov 29 19:25:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-546e30b9-2323-4e3c-82f4-7ab10b84b041 req-4fd16e40-bbe5-4159-8dcd-8650f8a692de service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-vif-unplugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-546e30b9-2323-4e3c-82f4-7ab10b84b041 req-4fd16e40-bbe5-4159-8dcd-8650f8a692de service nova] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-546e30b9-2323-4e3c-82f4-7ab10b84b041 req-4fd16e40-bbe5-4159-8dcd-8650f8a692de service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-546e30b9-2323-4e3c-82f4-7ab10b84b041 req-4fd16e40-bbe5-4159-8dcd-8650f8a692de service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-546e30b9-2323-4e3c-82f4-7ab10b84b041 req-4fd16e40-bbe5-4159-8dcd-8650f8a692de service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] No waiting events found dispatching network-vif-unplugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-546e30b9-2323-4e3c-82f4-7ab10b84b041 req-4fd16e40-bbe5-4159-8dcd-8650f8a692de service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-vif-unplugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Instance destroyed successfully.
Nov 29 19:25:03 user nova-compute[75235]: DEBUG nova.objects.instance [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lazy-loading 'resources' on Instance uuid f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1222290705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1222290',id=40,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF08Irm6U2Hj1gSD34rPZLJiMYkIq16YHovUwA+QbTQrvju5m8QTrgamnwBF+fEE4DhyouJYpga9GaXakR5Ih8uXCgJLyOPeqUySA/QYGjGaUGTr2Yn3/fVTuT61l9Pe8w==',key_name='tempest-keypair-1475719509',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe7a2206ddff474597fe976a3ca04f00',ramdisk_id='',reservation_id='r-v3566gxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-97871556',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:22:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e390c65285a14e01ad47bad2830538d6',uuid=f20a7f8c-f2e8-4b9a-9652-2032c9159cb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Converting VIF {"id": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "address": "fa:16:3e:cb:c4:0c", "network": {"id": "3a2f70ff-e14b-4cec-8f8e-ab965879efb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-715145073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe7a2206ddff474597fe976a3ca04f00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc3904a1-c0", "ovs_interfaceid": "dc3904a1-c0f9-44f2-baf0-dd8b240d1b45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG os_vif [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc3904a1-c0, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b91a059-59f9-4556-9310-6a40d9737b76) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:03 user nova-compute[75235]: INFO os_vif [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:c4:0c,bridge_name='br-int',has_traffic_filtering=True,id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45,network=Network(3a2f70ff-e14b-4cec-8f8e-ab965879efb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc3904a1-c0')
Nov 29 19:25:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Deleting instance files /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7_del
Nov 29 19:25:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Deletion of /opt/stack/data/nova/instances/f20a7f8c-f2e8-4b9a-9652-2032c9159cb7_del complete
Nov 29 19:25:03 user nova-compute[75235]: INFO nova.compute.manager [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 19:25:03 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:25:03 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:04 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Took 0.76 seconds to deallocate network for instance.
Nov 29 19:25:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-57db6ec7-c2fd-4015-963c-19fa04c3be76 req-bb4e5c58-23ef-4aa3-939f-d5cf6b56343d service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-vif-deleted-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:04 user nova-compute[75235]: INFO nova.compute.manager [req-57db6ec7-c2fd-4015-963c-19fa04c3be76 req-bb4e5c58-23ef-4aa3-939f-d5cf6b56343d service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Neutron deleted interface dc3904a1-c0f9-44f2-baf0-dd8b240d1b45; detaching it from the instance and deleting it from the info cache
Nov 29 19:25:04 user nova-compute[75235]: DEBUG nova.network.neutron [req-57db6ec7-c2fd-4015-963c-19fa04c3be76 req-bb4e5c58-23ef-4aa3-939f-d5cf6b56343d service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG nova.compute.manager [req-57db6ec7-c2fd-4015-963c-19fa04c3be76 req-bb4e5c58-23ef-4aa3-939f-d5cf6b56343d service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Detach interface failed, port_id=dc3904a1-c0f9-44f2-baf0-dd8b240d1b45, reason: Instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:25:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:04 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Deleted allocations for instance f20a7f8c-f2e8-4b9a-9652-2032c9159cb7
Nov 29 19:25:04 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-09c592ee-866e-4687-816d-2c79ac8091b4 tempest-TestServerVolumeAttachScenarioOldVersion-97871556 tempest-TestServerVolumeAttachScenarioOldVersion-97871556-project-member] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-2044fdc8-c248-4b1d-8980-d73f03a3c3ac req-bb8fbfa5-ec07-42d5-b7be-070cdf48b883 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received event network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2044fdc8-c248-4b1d-8980-d73f03a3c3ac req-bb8fbfa5-ec07-42d5-b7be-070cdf48b883 service nova] Acquiring lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2044fdc8-c248-4b1d-8980-d73f03a3c3ac req-bb8fbfa5-ec07-42d5-b7be-070cdf48b883 service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2044fdc8-c248-4b1d-8980-d73f03a3c3ac req-bb8fbfa5-ec07-42d5-b7be-070cdf48b883 service nova] Lock "f20a7f8c-f2e8-4b9a-9652-2032c9159cb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-2044fdc8-c248-4b1d-8980-d73f03a3c3ac req-bb8fbfa5-ec07-42d5-b7be-070cdf48b883 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] No waiting events found dispatching network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:05 user nova-compute[75235]: WARNING nova.compute.manager [req-2044fdc8-c248-4b1d-8980-d73f03a3c3ac req-bb8fbfa5-ec07-42d5-b7be-070cdf48b883 service nova] [instance: f20a7f8c-f2e8-4b9a-9652-2032c9159cb7] Received unexpected event network-vif-plugged-dc3904a1-c0f9-44f2-baf0-dd8b240d1b45 for instance with vm_state deleted and task_state None.
Nov 29 19:25:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:25:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:25:11 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=24.88019561767578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance c0628a53-2856-47c2-8b64-651c656f9d93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance b53656ac-d97b-4845-9be5-04f96f00d07e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance a54d682f-41ac-4ab4-b622-3659d507016b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 864ba3bb-968d-48a1-96d1-157a6f3feb18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 60faf673-2cc5-463b-8d72-98943c8e4c5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 868639e7-8048-4f4d-b3b2-53834cd3dbd8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:25:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:25:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:25:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:25:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:25:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating instance_info_cache with network_info: [{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:16 user nova-compute[75235]: INFO nova.compute.manager [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Detaching volume 5b1a74c9-e2b6-4687-b55b-c9c390a89aa5
Nov 29 19:25:16 user nova-compute[75235]: INFO nova.virt.block_device [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Attempting to driver detach volume 5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 from mountpoint /dev/vdb
Nov 29 19:25:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Attempting to detach device vdb from instance 60faf673-2cc5-463b-8d72-98943c8e4c5f from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:25:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:25:16 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:25:16 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:25:16 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:25:16 user nova-compute[75235]:   <serial>5b1a74c9-e2b6-4687-b55b-c9c390a89aa5</serial>
Nov 29 19:25:16 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:25:16 user nova-compute[75235]: </disk>
Nov 29 19:25:16 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:25:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully detached device vdb from instance 60faf673-2cc5-463b-8d72-98943c8e4c5f from the persistent domain config.
Nov 29 19:25:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60faf673-2cc5-463b-8d72-98943c8e4c5f from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:25:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:25:16 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:25:16 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:25:16 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:25:16 user nova-compute[75235]:   <serial>5b1a74c9-e2b6-4687-b55b-c9c390a89aa5</serial>
Nov 29 19:25:16 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:25:16 user nova-compute[75235]: </disk>
Nov 29 19:25:16 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:25:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60faf673-2cc5-463b-8d72-98943c8e4c5f {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:25:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:24 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-changed-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG nova.compute.manager [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Refreshing instance network info cache due to event network-changed-442e2ec7-1fc5-414a-8dce-4b87e2c201c8. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] Acquiring lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] Acquired lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG nova.network.neutron [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Refreshing network info cache for port 442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:25 user nova-compute[75235]: INFO nova.compute.manager [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Terminating instance
Nov 29 19:25:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updated VIF entry in instance network info cache for port 442e2ec7-1fc5-414a-8dce-4b87e2c201c8. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating instance_info_cache with network_info: [{"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a66bf744-76c3-45a3-981f-b904948f6a92 req-b5f0a559-9896-4741-a349-229f88fc1e0c service nova] Releasing lock "refresh_cache-a54d682f-41ac-4ab4-b622-3659d507016b" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-4f0d0039-4ab6-4d9e-8641-6a200197ca86 req-6fdc8807-f398-49ff-9916-b04fd6da775c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-vif-unplugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4f0d0039-4ab6-4d9e-8641-6a200197ca86 req-6fdc8807-f398-49ff-9916-b04fd6da775c service nova] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4f0d0039-4ab6-4d9e-8641-6a200197ca86 req-6fdc8807-f398-49ff-9916-b04fd6da775c service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4f0d0039-4ab6-4d9e-8641-6a200197ca86 req-6fdc8807-f398-49ff-9916-b04fd6da775c service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-4f0d0039-4ab6-4d9e-8641-6a200197ca86 req-6fdc8807-f398-49ff-9916-b04fd6da775c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] No waiting events found dispatching network-vif-unplugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-4f0d0039-4ab6-4d9e-8641-6a200197ca86 req-6fdc8807-f398-49ff-9916-b04fd6da775c service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-vif-unplugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:25:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Instance destroyed successfully.
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.objects.instance [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lazy-loading 'resources' on Instance uuid a54d682f-41ac-4ab4-b622-3659d507016b {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1775697525',display_name='tempest-TestStampPattern-server-1775697525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1775697525',id=36,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn3xVYo+E0cU9Uy/fU7QjtKHhvF/x6NUW0tu+5nR3jqZ7TBsLl5Pf/NwyWXbpCskpo3RJCjL48V0UetcFJscnJorQKUz2IcUOa+ov7qXiZkRoF+eVV193Dgm56Xr3HCCw==',key_name='tempest-TestStampPattern-1606459428',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:18:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4c6fb0f9a004400a2448ad9ecdf7b6e',ramdisk_id='',reservation_id='r-nygavnac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2015071819',owner_user_name='tempest-TestStampPattern-2015071819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:21:29Z,user_data=None,user_id='2ded506037834e6783ff09742a34fca0',uuid=a54d682f-41ac-4ab4-b622-3659d507016b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converting VIF {"id": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "address": "fa:16:3e:a4:ed:97", "network": {"id": "8fa3deee-9b6a-45cc-b491-3a9bd3afa80b", "bridge": "br-int", "label": "tempest-TestStampPattern-1422814078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4c6fb0f9a004400a2448ad9ecdf7b6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap442e2ec7-1f", "ovs_interfaceid": "442e2ec7-1fc5-414a-8dce-4b87e2c201c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG os_vif [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap442e2ec7-1f, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=862e3ab3-5807-44e3-9d7e-583acae27f37) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:26 user nova-compute[75235]: INFO os_vif [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ed:97,bridge_name='br-int',has_traffic_filtering=True,id=442e2ec7-1fc5-414a-8dce-4b87e2c201c8,network=Network(8fa3deee-9b6a-45cc-b491-3a9bd3afa80b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap442e2ec7-1f')
Nov 29 19:25:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Deleting instance files /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b_del
Nov 29 19:25:26 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Deletion of /opt/stack/data/nova/instances/a54d682f-41ac-4ab4-b622-3659d507016b_del complete
Nov 29 19:25:26 user nova-compute[75235]: INFO nova.compute.manager [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 29 19:25:26 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:25:26 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:25:27 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:27 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Took 0.40 seconds to deallocate network for instance.
Nov 29 19:25:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:27 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:25:27 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:25:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:27 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Deleted allocations for instance a54d682f-41ac-4ab4-b622-3659d507016b
Nov 29 19:25:27 user nova-compute[75235]: DEBUG nova.compute.manager [req-88061a2e-bcfe-4296-a470-702bb170afbb req-e587172a-f1e7-421d-b280-e03e54163483 service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-vif-deleted-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461d245e-af40-4e8a-a0a0-c666e66b8f20 tempest-TestStampPattern-2015071819 tempest-TestStampPattern-2015071819-project-member] Lock "a54d682f-41ac-4ab4-b622-3659d507016b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.014s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-f863633a-bbb1-4b6b-b679-66a242b837db req-9c2c7486-03d6-4856-932c-49488f0bd6ed service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received event network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f863633a-bbb1-4b6b-b679-66a242b837db req-9c2c7486-03d6-4856-932c-49488f0bd6ed service nova] Acquiring lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f863633a-bbb1-4b6b-b679-66a242b837db req-9c2c7486-03d6-4856-932c-49488f0bd6ed service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f863633a-bbb1-4b6b-b679-66a242b837db req-9c2c7486-03d6-4856-932c-49488f0bd6ed service nova] Lock "a54d682f-41ac-4ab4-b622-3659d507016b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-f863633a-bbb1-4b6b-b679-66a242b837db req-9c2c7486-03d6-4856-932c-49488f0bd6ed service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] No waiting events found dispatching network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:28 user nova-compute[75235]: WARNING nova.compute.manager [req-f863633a-bbb1-4b6b-b679-66a242b837db req-9c2c7486-03d6-4856-932c-49488f0bd6ed service nova] [instance: a54d682f-41ac-4ab4-b622-3659d507016b] Received unexpected event network-vif-plugged-442e2ec7-1fc5-414a-8dce-4b87e2c201c8 for instance with vm_state deleted and task_state None.
Nov 29 19:25:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:36 user nova-compute[75235]: INFO nova.compute.manager [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Terminating instance
Nov 29 19:25:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-0a8b1dc1-36f9-46ed-9762-df348aefdbfb req-bfdaefba-5ff9-44b2-b7a3-bc99e24ef096 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0a8b1dc1-36f9-46ed-9762-df348aefdbfb req-bfdaefba-5ff9-44b2-b7a3-bc99e24ef096 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0a8b1dc1-36f9-46ed-9762-df348aefdbfb req-bfdaefba-5ff9-44b2-b7a3-bc99e24ef096 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0a8b1dc1-36f9-46ed-9762-df348aefdbfb req-bfdaefba-5ff9-44b2-b7a3-bc99e24ef096 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-0a8b1dc1-36f9-46ed-9762-df348aefdbfb req-bfdaefba-5ff9-44b2-b7a3-bc99e24ef096 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-0a8b1dc1-36f9-46ed-9762-df348aefdbfb req-bfdaefba-5ff9-44b2-b7a3-bc99e24ef096 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-unplugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:25:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Instance destroyed successfully.
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.objects.instance [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'resources' on Instance uuid b53656ac-d97b-4845-9be5-04f96f00d07e {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-270576405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-270576405',id=28,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:11:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-gl6y1qrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:13:37Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=b53656ac-d97b-4845-9be5-04f96f00d07e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "98e2266a-a115-4895-b4a6-d367103eed30", "address": "fa:16:3e:ce:33:3f", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e2266a-a1", "ovs_interfaceid": "98e2266a-a115-4895-b4a6-d367103eed30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_vif [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:25:37 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60faf673-2cc5-463b-8d72-98943c8e4c5f is timed out.
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98e2266a-a1, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully detached device vdb from instance 60faf673-2cc5-463b-8d72-98943c8e4c5f from the live domain config.
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b99e380-c2a3-4f98-b85f-118309d0de99) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeSrzUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:25:37 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: INFO os_vif [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:33:3f,bridge_name='br-int',has_traffic_filtering=True,id=98e2266a-a115-4895-b4a6-d367103eed30,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e2266a-a1')
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzBLxwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:25:37 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0129a-ce71-4720-bbe9-c799b213f5f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:25:37 user nova-compute[75235]: No targets found.
Nov 29 19:25:37 user nova-compute[75235]: iSNS:
Nov 29 19:25:37 user nova-compute[75235]: No targets found.
Nov 29 19:25:37 user nova-compute[75235]: STATIC:
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: FIRMWARE:
Nov 29 19:25:37 user nova-compute[75235]: No targets found.
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:25:37 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:25:37 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfc521-85b5-4cca-b868-155748b62e98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[be307a63-cdaa-45c5-a679-4789d01025f2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565944b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd6a80-fa5e-4a5e-9de8-dbf8b65584a2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ac227-1e42-4a8f-b41c-7278d3749dea]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f092d-aaf1-4f9e-8c53-de8cdf402b36]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992bb6e-369a-42d0-b2ce-042961887d15]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15068f1-a5b1-4511-b8cd-0ea87c3e0473]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fcf9c7-94b9-418a-8f82-9ec4264e8d8c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260]
Nov 29 19:25:37 user nova-compute[75235]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5, portal: 172.16.0.220,3260] successful.
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5936b1c4-f8c3-42b7-b2e9-d5eea1cf3716]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== disconnect_volume: return (359ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.343s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[116b27f5-78b8-4890-aa1f-7719231c602f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:25:37 user nova-compute[75235]: No targets found.
Nov 29 19:25:37 user nova-compute[75235]: iSNS:
Nov 29 19:25:37 user nova-compute[75235]: No targets found.
Nov 29 19:25:37 user nova-compute[75235]: STATIC:
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5
Nov 29 19:25:37 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:37 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:37 user nova-compute[75235]: FIRMWARE:
Nov 29 19:25:37 user nova-compute[75235]: No targets found.
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:25:37 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:25:37 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9278ac0f-e151-41de-b24f-17d42a2905b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[92361875-2bb1-49cc-a3db-e7cd93cd205f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c6b9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5'): ({'sde'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Removing single pathed devices sde {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9f99a-03f8-4ec1-8e3f-fe5b92eb0a0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dbd448-7dd3-4948-bda1-3fd2901686b4]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Flushing IO for device /dev/sde {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed33c52-8d0c-44b9-8ccf-c3829b10e284]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea8e915-ca3c-445a-9d03-85a6bd612fe0]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] SCSI volumes sde have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[993dfc28-0757-43d7-b464-93c99632d617]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.153s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41ddfd8-9ec3-4e10-87cf-ccea0f1da4d4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260]
Nov 29 19:25:37 user nova-compute[75235]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5, portal: 172.16.0.220,3260] successful.
Nov 29 19:25:37 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747108f3-52f2-4145-a286-a99ff5c225e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[37684965-0297-4f82-aa12-7649cbcb1928]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] <== disconnect_volume: return (753ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:25:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Deleting instance files /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e_del
Nov 29 19:25:37 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Deletion of /opt/stack/data/nova/instances/b53656ac-d97b-4845-9be5-04f96f00d07e_del complete
Nov 29 19:25:37 user nova-compute[75235]: INFO nova.compute.manager [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 29 19:25:37 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:25:37 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'flavor' on Instance uuid 60faf673-2cc5-463b-8d72-98943c8e4c5f {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ddd04366-e788-4bdb-bcf5-72c968ec17c4 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.876s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.721s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:38 user nova-compute[75235]: INFO nova.compute.manager [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Terminating instance
Nov 29 19:25:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:38 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Took 0.55 seconds to deallocate network for instance.
Nov 29 19:25:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-1557806d-510d-47f7-86fa-9585e9898ab9 req-d0cff695-1210-4900-9c12-2c8fcdf55729 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-deleted-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-f061df11-d29f-452d-844a-15803e45e541 req-776c04bb-16aa-4a7a-b413-7635f8f1eee7 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f061df11-d29f-452d-844a-15803e45e541 req-776c04bb-16aa-4a7a-b413-7635f8f1eee7 service nova] Acquiring lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f061df11-d29f-452d-844a-15803e45e541 req-776c04bb-16aa-4a7a-b413-7635f8f1eee7 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f061df11-d29f-452d-844a-15803e45e541 req-776c04bb-16aa-4a7a-b413-7635f8f1eee7 service nova] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-f061df11-d29f-452d-844a-15803e45e541 req-776c04bb-16aa-4a7a-b413-7635f8f1eee7 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] No waiting events found dispatching network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:38 user nova-compute[75235]: WARNING nova.compute.manager [req-f061df11-d29f-452d-844a-15803e45e541 req-776c04bb-16aa-4a7a-b413-7635f8f1eee7 service nova] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Received unexpected event network-vif-plugged-98e2266a-a115-4895-b4a6-d367103eed30 for instance with vm_state active and task_state deleting.
Nov 29 19:25:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Instance destroyed successfully.
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'resources' on Instance uuid 60faf673-2cc5-463b-8d72-98943c8e4c5f {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1288015214',display_name='tempest-VolumesSnapshotTestJSON-instance-1288015214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1288015214',id=42,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA7y1i+ggIgACD0j3fRIlEYHytKFjSdvks00fEHSY/x6NuhR0/h34AcbE9aN+P6QQYOT4kFpiXKjfNnI9LYBCoUZTI6GIlLBh6AyBlFZePVsrdNI8yySSwuOgB2fGiaiQ==',key_name='tempest-keypair-1198979514',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ad88693560a465299e61e263c402de3',ramdisk_id='',reservation_id='r-m74oku0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1975532199',owner_user_name='tempest-VolumesSnapshotTestJSON-1975532199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aec9d4541474364baae470f90efe2ea',uuid=60faf673-2cc5-463b-8d72-98943c8e4c5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converting VIF {"id": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "address": "fa:16:3e:10:54:cf", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9e9572-5d", "ovs_interfaceid": "0d9e9572-5d93-4473-86ff-82a5cb1eaf32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_vif [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d9e9572-5d, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32b588e8-e6f3-4fee-b7e2-f543384fd85a) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:39 user nova-compute[75235]: INFO os_vif [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:54:cf,bridge_name='br-int',has_traffic_filtering=True,id=0d9e9572-5d93-4473-86ff-82a5cb1eaf32,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9e9572-5d')
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZeSrzUwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:25:39 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:39 user nova-compute[75235]: INFO nova.compute.manager [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: b53656ac-d97b-4845-9be5-04f96f00d07e] Took 0.89 seconds to detach 1 volumes for instance.
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0072ff-0eb4-450b-a14c-fd7d34444784]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:25:39 user nova-compute[75235]: No targets found.
Nov 29 19:25:39 user nova-compute[75235]: iSNS:
Nov 29 19:25:39 user nova-compute[75235]: No targets found.
Nov 29 19:25:39 user nova-compute[75235]: STATIC:
Nov 29 19:25:39 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307
Nov 29 19:25:39 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:39 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:39 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:25:39 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:25:39 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:25:39 user nova-compute[75235]: FIRMWARE:
Nov 29 19:25:39 user nova-compute[75235]: No targets found.
Nov 29 19:25:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:25:39 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:25:39 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1a74c9-e2b6-4687-b55b-c9c390a89aa5', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5904b0-2a49-4e8f-8ec6-7b0097d60793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf84d7-e258-478e-a929-08fa8ba82bdb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:25:39 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:25:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:25:39 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:25:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5650516dd0>, {}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Disconnecting from: [] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== disconnect_volume: return (85ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:25:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Deleting instance files /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f_del
Nov 29 19:25:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Deletion of /opt/stack/data/nova/instances/60faf673-2cc5-463b-8d72-98943c8e4c5f_del complete
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:39 user nova-compute[75235]: INFO nova.compute.manager [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:39 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Deleted allocations for instance b53656ac-d97b-4845-9be5-04f96f00d07e
Nov 29 19:25:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-92ec98fd-faef-4834-a38c-bf2d1ed9f620 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "b53656ac-d97b-4845-9be5-04f96f00d07e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.426s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:40 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Took 0.83 seconds to deallocate network for instance.
Nov 29 19:25:40 user nova-compute[75235]: WARNING nova.volume.cinder [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Attachment 3d043bed-0d0f-49db-82b0-467bab00d46b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3d043bed-0d0f-49db-82b0-467bab00d46b. (HTTP 404) (Request-ID: req-af68a5a8-024b-43fd-bdd3-7d4a380a1c6c)
Nov 29 19:25:40 user nova-compute[75235]: INFO nova.compute.manager [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-vif-unplugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] No waiting events found dispatching network-vif-unplugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:40 user nova-compute[75235]: WARNING nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received unexpected event network-vif-unplugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 for instance with vm_state deleted and task_state None.
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] Acquiring lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] No waiting events found dispatching network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:40 user nova-compute[75235]: WARNING nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received unexpected event network-vif-plugged-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 for instance with vm_state deleted and task_state None.
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-c92111a9-60d1-4bd0-b319-d5923e595b79 req-2d27e149-d633-4102-9bf1-7cb48987c05f service nova] [instance: 60faf673-2cc5-463b-8d72-98943c8e4c5f] Received event network-vif-deleted-0d9e9572-5d93-4473-86ff-82a5cb1eaf32 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:40 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Deleted allocations for instance 60faf673-2cc5-463b-8d72-98943c8e4c5f
Nov 29 19:25:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e04a3c5a-de5f-4c7d-a38d-a39a252ccd61 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "60faf673-2cc5-463b-8d72-98943c8e4c5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "c0628a53-2856-47c2-8b64-651c656f9d93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:42 user nova-compute[75235]: INFO nova.compute.manager [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Terminating instance
Nov 29 19:25:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-9874b2b5-cb5e-49f5-80a7-5f56a30862ae req-d5d3c41c-9d60-496a-8b2d-8fc68c4f1227 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-unplugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9874b2b5-cb5e-49f5-80a7-5f56a30862ae req-d5d3c41c-9d60-496a-8b2d-8fc68c4f1227 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9874b2b5-cb5e-49f5-80a7-5f56a30862ae req-d5d3c41c-9d60-496a-8b2d-8fc68c4f1227 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9874b2b5-cb5e-49f5-80a7-5f56a30862ae req-d5d3c41c-9d60-496a-8b2d-8fc68c4f1227 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-9874b2b5-cb5e-49f5-80a7-5f56a30862ae req-d5d3c41c-9d60-496a-8b2d-8fc68c4f1227 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-unplugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-9874b2b5-cb5e-49f5-80a7-5f56a30862ae req-d5d3c41c-9d60-496a-8b2d-8fc68c4f1227 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-unplugged-b2361512-bf5c-4207-b459-21548580307c for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Instance destroyed successfully.
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.objects.instance [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'resources' on Instance uuid c0628a53-2856-47c2-8b64-651c656f9d93 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1713780664',display_name='tempest-ServerRescueNegativeTestJSON-server-1713780664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1713780664',id=26,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-4r2ixeg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:11:31Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=c0628a53-2856-47c2-8b64-651c656f9d93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "b2361512-bf5c-4207-b459-21548580307c", "address": "fa:16:3e:91:f4:ba", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2361512-bf", "ovs_interfaceid": "b2361512-bf5c-4207-b459-21548580307c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG os_vif [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2361512-bf, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44a69973-f912-43df-b470-05a7337d5b86) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:43 user nova-compute[75235]: INFO os_vif [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f4:ba,bridge_name='br-int',has_traffic_filtering=True,id=b2361512-bf5c-4207-b459-21548580307c,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2361512-bf')
Nov 29 19:25:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Deleting instance files /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93_del
Nov 29 19:25:43 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Deletion of /opt/stack/data/nova/instances/c0628a53-2856-47c2-8b64-651c656f9d93_del complete
Nov 29 19:25:43 user nova-compute[75235]: INFO nova.compute.manager [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 19:25:43 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:25:43 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:25:44 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:25:44 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Took 0.84 seconds to deallocate network for instance.
Nov 29 19:25:44 user nova-compute[75235]: DEBUG nova.compute.manager [req-48fc3d6f-db48-49a8-8361-21725cad66a2 req-4e2fb00c-5dc9-48e3-828b-ce16f32ebac0 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-deleted-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:44 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:25:44 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:25:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:44 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Deleted allocations for instance c0628a53-2856-47c2-8b64-651c656f9d93
Nov 29 19:25:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-041570c6-ca2f-47e1-b2d6-e4fb4a8f5577 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "c0628a53-2856-47c2-8b64-651c656f9d93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-fd0fe9e4-29a0-4b34-adf0-6b13395933b3 req-7f701737-8c8a-400a-adf3-b6005aae1e97 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:25:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fd0fe9e4-29a0-4b34-adf0-6b13395933b3 req-7f701737-8c8a-400a-adf3-b6005aae1e97 service nova] Acquiring lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:25:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fd0fe9e4-29a0-4b34-adf0-6b13395933b3 req-7f701737-8c8a-400a-adf3-b6005aae1e97 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:25:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fd0fe9e4-29a0-4b34-adf0-6b13395933b3 req-7f701737-8c8a-400a-adf3-b6005aae1e97 service nova] Lock "c0628a53-2856-47c2-8b64-651c656f9d93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:25:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-fd0fe9e4-29a0-4b34-adf0-6b13395933b3 req-7f701737-8c8a-400a-adf3-b6005aae1e97 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] No waiting events found dispatching network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:25:45 user nova-compute[75235]: WARNING nova.compute.manager [req-fd0fe9e4-29a0-4b34-adf0-6b13395933b3 req-7f701737-8c8a-400a-adf3-b6005aae1e97 service nova] [instance: c0628a53-2856-47c2-8b64-651c656f9d93] Received unexpected event network-vif-plugged-b2361512-bf5c-4207-b459-21548580307c for instance with vm_state deleted and task_state None.
Nov 29 19:25:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:25:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:25:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-changed-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:02 user nova-compute[75235]: DEBUG nova.compute.manager [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Refreshing instance network info cache due to event network-changed-eb14eaa9-33df-477e-a324-0f79725fdcb2. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:26:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] Acquiring lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:26:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] Acquired lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:26:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Refreshing network info cache for port eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG nova.network.neutron [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updated VIF entry in instance network info cache for port eb14eaa9-33df-477e-a324-0f79725fdcb2. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG nova.network.neutron [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updating instance_info_cache with network_info: [{"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-fe78176a-4dbd-4a93-85d5-2b9b43e75a32 req-53096e03-056b-4814-beca-77543e923f52 service nova] Releasing lock "refresh_cache-868639e7-8048-4f4d-b3b2-53834cd3dbd8" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:03 user nova-compute[75235]: INFO nova.compute.manager [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Terminating instance
Nov 29 19:26:03 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-d1f6bab8-2898-446c-82d4-d29d0e2a0d29 req-c96a3f5a-eb03-47ca-9a4e-95cfc7289290 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-vif-unplugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d1f6bab8-2898-446c-82d4-d29d0e2a0d29 req-c96a3f5a-eb03-47ca-9a4e-95cfc7289290 service nova] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d1f6bab8-2898-446c-82d4-d29d0e2a0d29 req-c96a3f5a-eb03-47ca-9a4e-95cfc7289290 service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d1f6bab8-2898-446c-82d4-d29d0e2a0d29 req-c96a3f5a-eb03-47ca-9a4e-95cfc7289290 service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-d1f6bab8-2898-446c-82d4-d29d0e2a0d29 req-c96a3f5a-eb03-47ca-9a4e-95cfc7289290 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] No waiting events found dispatching network-vif-unplugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-d1f6bab8-2898-446c-82d4-d29d0e2a0d29 req-c96a3f5a-eb03-47ca-9a4e-95cfc7289290 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-vif-unplugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Instance destroyed successfully.
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.objects.instance [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'resources' on Instance uuid 868639e7-8048-4f4d-b3b2-53834cd3dbd8 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-775136502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-775136502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-775136502',id=43,image_ref='cddbe5f6-1f0a-46e1-a3ed-c3352f050592',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjKMdfaDdp7cyBUhbksofzQx5K7ONOqHtxxLqIPZr73kJkh9zVc2kkr21nFAzQcb2XxkQxUj2oYX/V9C0HWKqDE6wTWsjuEjwmyB/t0qf9+k3mcwYNRU/R+aPaC1j1X9g==',key_name='tempest-keypair-1518402171',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:24:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-yocbh437',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-656128499',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20d52323a014526b5ebd121d637f4c4',uuid=868639e7-8048-4f4d-b3b2-53834cd3dbd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "address": "fa:16:3e:5e:76:e4", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb14eaa9-33", "ovs_interfaceid": "eb14eaa9-33df-477e-a324-0f79725fdcb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_vif [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb14eaa9-33, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=347d5560-8375-429c-845d-bd3f24b9648a) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:04 user nova-compute[75235]: INFO os_vif [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:e4,bridge_name='br-int',has_traffic_filtering=True,id=eb14eaa9-33df-477e-a324-0f79725fdcb2,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb14eaa9-33')
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efQzotCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:26:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc2934e-55c6-49a3-ad35-15078c8572dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:26:04 user nova-compute[75235]: No targets found.
Nov 29 19:26:04 user nova-compute[75235]: iSNS:
Nov 29 19:26:04 user nova-compute[75235]: No targets found.
Nov 29 19:26:04 user nova-compute[75235]: STATIC:
Nov 29 19:26:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307
Nov 29 19:26:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:26:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:26:04 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:26:04 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:26:04 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:26:04 user nova-compute[75235]: FIRMWARE:
Nov 29 19:26:04 user nova-compute[75235]: No targets found.
Nov 29 19:26:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:26:04 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:26:04 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1430945-3bac-4b4f-b4d1-0326ec7f52ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e551c5f-62c7-4fc2-869c-2574b96a0428]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:26:04 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:26:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:26:04 user nova-compute[75235]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 (non-flash)
Nov 29 19:26:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565823b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41ad568-d1cd-4fac-bbd1-a393e7b89a31]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b4320-acd1-4dd6-8feb-46a32ee4f02b]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[519772c6-90f4-476c-9d28-4f953512757d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927828e-a6a9-43e6-9f70-ba379a140660]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26263386334653364', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a59b788', '/dev/disk/by-id/scsi-1SCST_BIO4a59b788-bc8c4e3de0464260') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[10efe613-b2bd-40cf-92cd-33cf485f55af]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e4b08-e7ac-4b2e-91ad-5e7c389f2332]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb64f4-3852-4e1f-aa60-25a0feffde4c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260]
Nov 29 19:26:04 user nova-compute[75235]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307, portal: 172.16.0.220,3260] successful.
Nov 29 19:26:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f246c860-a181-4f34-8efa-1a4c8aa01307 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfcf878-f697-40ae-9a2b-be265ab4b69b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== disconnect_volume: return (345ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:26:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Deleting instance files /opt/stack/data/nova/instances/868639e7-8048-4f4d-b3b2-53834cd3dbd8_del
Nov 29 19:26:04 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Deletion of /opt/stack/data/nova/instances/868639e7-8048-4f4d-b3b2-53834cd3dbd8_del complete
Nov 29 19:26:04 user nova-compute[75235]: INFO nova.compute.manager [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 29 19:26:04 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:26:04 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:26:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5040176c-1e2e-4c6f-98ef-c41c5eea4468 req-4a958caa-f3a4-432e-aef0-fcc7f63be795 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5040176c-1e2e-4c6f-98ef-c41c5eea4468 req-4a958caa-f3a4-432e-aef0-fcc7f63be795 service nova] Acquiring lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5040176c-1e2e-4c6f-98ef-c41c5eea4468 req-4a958caa-f3a4-432e-aef0-fcc7f63be795 service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5040176c-1e2e-4c6f-98ef-c41c5eea4468 req-4a958caa-f3a4-432e-aef0-fcc7f63be795 service nova] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-5040176c-1e2e-4c6f-98ef-c41c5eea4468 req-4a958caa-f3a4-432e-aef0-fcc7f63be795 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] No waiting events found dispatching network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:05 user nova-compute[75235]: WARNING nova.compute.manager [req-5040176c-1e2e-4c6f-98ef-c41c5eea4468 req-4a958caa-f3a4-432e-aef0-fcc7f63be795 service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received unexpected event network-vif-plugged-eb14eaa9-33df-477e-a324-0f79725fdcb2 for instance with vm_state active and task_state deleting.
Nov 29 19:26:06 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:06 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Took 1.52 seconds to deallocate network for instance.
Nov 29 19:26:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-494e8dbf-61b2-40e7-b302-f8546f69b7f1 req-7c881661-047f-43de-980c-269448fcc34a service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Received event network-vif-deleted-eb14eaa9-33df-477e-a324-0f79725fdcb2 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:06 user nova-compute[75235]: INFO nova.compute.manager [req-494e8dbf-61b2-40e7-b302-f8546f69b7f1 req-7c881661-047f-43de-980c-269448fcc34a service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Neutron deleted interface eb14eaa9-33df-477e-a324-0f79725fdcb2; detaching it from the instance and deleting it from the info cache
Nov 29 19:26:06 user nova-compute[75235]: DEBUG nova.network.neutron [req-494e8dbf-61b2-40e7-b302-f8546f69b7f1 req-7c881661-047f-43de-980c-269448fcc34a service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:06 user nova-compute[75235]: DEBUG nova.compute.manager [req-494e8dbf-61b2-40e7-b302-f8546f69b7f1 req-7c881661-047f-43de-980c-269448fcc34a service nova] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Detach interface failed, port_id=eb14eaa9-33df-477e-a324-0f79725fdcb2, reason: Instance 868639e7-8048-4f4d-b3b2-53834cd3dbd8 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:26:07 user nova-compute[75235]: INFO nova.compute.manager [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Took 0.91 seconds to detach 1 volumes for instance.
Nov 29 19:26:07 user nova-compute[75235]: DEBUG nova.compute.manager [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 868639e7-8048-4f4d-b3b2-53834cd3dbd8] Deleting volume: f246c860-a181-4f34-8efa-1a4c8aa01307 {{(pid=75235) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 19:26:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:07 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:26:07 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:26:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:07 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Deleted allocations for instance 868639e7-8048-4f4d-b3b2-53834cd3dbd8
Nov 29 19:26:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-dbf2c446-cfe7-4510-8589-77fffcfdeddf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "868639e7-8048-4f4d-b3b2-53834cd3dbd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.148s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:09 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:26:09 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:26:09 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.043182373046875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 9d57cb98-5640-4104-ab59-fc0f4786433c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 5380cf96-db98-487d-a6b5-bec6948e12a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 864ba3bb-968d-48a1-96d1-157a6f3feb18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:26:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:26:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:26:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:27 user nova-compute[75235]: INFO nova.compute.manager [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Terminating instance
Nov 29 19:26:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:27 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:26:27 user nova-compute[75235]: INFO nova.compute.claims [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Claim successful on node user
Nov 29 19:26:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.network.neutron [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:26:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.policy [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aec9d4541474364baae470f90efe2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad88693560a465299e61e263c402de3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:26:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Creating image(s)
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "/opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "/opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "/opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Instance destroyed successfully.
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.objects.instance [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lazy-loading 'resources' on Instance uuid 9d57cb98-5640-4104-ab59-fc0f4786433c {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:05:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718120687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718120687',id=18,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b84f68d6c554611a982ef7326409952',ramdisk_id='',reservation_id='r-80iwsbb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:07:57Z,user_data=None,user_id='c547f019112442b7ac97442ce3432365',uuid=9d57cb98-5640-4104-ab59-fc0f4786433c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converting VIF {"id": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "address": "fa:16:3e:cd:f3:10", "network": {"id": "8646bc27-f1e6-4b86-ae49-8288ef8dac63", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-108734320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b84f68d6c554611a982ef7326409952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5671a6-9e", "ovs_interfaceid": "5f5671a6-9e9f-4e2b-9e46-dbd420e435d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG os_vif [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5671a6-9e, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d880ee6c-aac1-46e3-84be-a316f0d14e06) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:28 user nova-compute[75235]: INFO os_vif [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:f3:10,bridge_name='br-int',has_traffic_filtering=True,id=5f5671a6-9e9f-4e2b-9e46-dbd420e435d6,network=Network(8646bc27-f1e6-4b86-ae49-8288ef8dac63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f5671a6-9e')
Nov 29 19:26:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Deleting instance files /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c_del
Nov 29 19:26:28 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Deletion of /opt/stack/data/nova/instances/9d57cb98-5640-4104-ab59-fc0f4786433c_del complete
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:28 user nova-compute[75235]: INFO nova.compute.manager [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-4e1c0f5a-d999-499f-a632-522f0f1723fc req-a974d4a3-546b-469e-bfb3-e24975a532a9 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-vif-unplugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4e1c0f5a-d999-499f-a632-522f0f1723fc req-a974d4a3-546b-469e-bfb3-e24975a532a9 service nova] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4e1c0f5a-d999-499f-a632-522f0f1723fc req-a974d4a3-546b-469e-bfb3-e24975a532a9 service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4e1c0f5a-d999-499f-a632-522f0f1723fc req-a974d4a3-546b-469e-bfb3-e24975a532a9 service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-4e1c0f5a-d999-499f-a632-522f0f1723fc req-a974d4a3-546b-469e-bfb3-e24975a532a9 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] No waiting events found dispatching network-vif-unplugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG nova.compute.manager [req-4e1c0f5a-d999-499f-a632-522f0f1723fc req-a974d4a3-546b-469e-bfb3-e24975a532a9 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-vif-unplugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk 1073741824" returned: 0 in 0.061s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:28 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.221s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.network.neutron [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Successfully created port: 1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Cannot resize image /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Ensure instance console log exists: /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:29 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Took 0.75 seconds to deallocate network for instance.
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.compute.manager [req-caeda10e-aafe-4450-ac36-1b9526ea1ad2 req-442fa6c4-3884-447a-a376-119cc084e044 service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-vif-deleted-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:26:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:30 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Deleted allocations for instance 9d57cb98-5640-4104-ab59-fc0f4786433c
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Successfully updated port: 1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquired lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-changed-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Refreshing instance network info cache due to event network-changed-1068923c-1a5a-4d34-9727-2f38755c7a26. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] Acquiring lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-ebaa4062-4702-4bc4-b924-1df9131712b2 tempest-ServerBootFromVolumeStableRescueTest-1553615524 tempest-ServerBootFromVolumeStableRescueTest-1553615524-project-member] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating instance_info_cache with network_info: [{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Releasing lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Instance network_info: |[{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] Acquired lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Refreshing network info cache for port 1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Start _get_guest_xml network_info=[{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:26:30 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:26:30 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-828681369',display_name='tempest-VolumesSnapshotTestJSON-instance-828681369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-828681369',id=44,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSXjOk3QuLTs/zlg0MrKxAX3hRXhVM5JGcwrG3SYK5//APBCLfIj0qz5cN19RC1hGPyNaF2jUdDRyBknIaDgMNlCgERK3h/cgytg8htBkwTw8S75uljcM/+CKZ9AQektw==',key_name='tempest-keypair-309916703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ad88693560a465299e61e263c402de3',ramdisk_id='',reservation_id='r-y5fatmke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1975532199',owner_user_name='tempest-VolumesSnapshotTestJSON-1975532199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aec9d4541474364baae470f90efe2ea',uuid=35a58a85-65f9-45b8-a8a3-f69ecfad5295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converting VIF {"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.objects.instance [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'pci_devices' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:26:30 user nova-compute[75235]:   <uuid>35a58a85-65f9-45b8-a8a3-f69ecfad5295</uuid>
Nov 29 19:26:30 user nova-compute[75235]:   <name>instance-0000002c</name>
Nov 29 19:26:30 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:26:30 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:26:30 user nova-compute[75235]:   <metadata>
Nov 29 19:26:30 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:26:30 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:26:30 user nova-compute[75235]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-828681369</nova:name>
Nov 29 19:26:30 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:26:30</nova:creationTime>
Nov 29 19:26:30 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:26:30 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:26:30 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:26:30 user nova-compute[75235]:       <nova:owner>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:user uuid="3aec9d4541474364baae470f90efe2ea">tempest-VolumesSnapshotTestJSON-1975532199-project-member</nova:user>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:project uuid="1ad88693560a465299e61e263c402de3">tempest-VolumesSnapshotTestJSON-1975532199</nova:project>
Nov 29 19:26:30 user nova-compute[75235]:       </nova:owner>
Nov 29 19:26:30 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:26:30 user nova-compute[75235]:       <nova:ports>
Nov 29 19:26:30 user nova-compute[75235]:         <nova:port uuid="1068923c-1a5a-4d34-9727-2f38755c7a26">
Nov 29 19:26:30 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 19:26:30 user nova-compute[75235]:         </nova:port>
Nov 29 19:26:30 user nova-compute[75235]:       </nova:ports>
Nov 29 19:26:30 user nova-compute[75235]:     </nova:instance>
Nov 29 19:26:30 user nova-compute[75235]:   </metadata>
Nov 29 19:26:30 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:26:30 user nova-compute[75235]:     <system>
Nov 29 19:26:30 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:26:30 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:26:30 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:26:30 user nova-compute[75235]:       <entry name="serial">35a58a85-65f9-45b8-a8a3-f69ecfad5295</entry>
Nov 29 19:26:30 user nova-compute[75235]:       <entry name="uuid">35a58a85-65f9-45b8-a8a3-f69ecfad5295</entry>
Nov 29 19:26:30 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:26:30 user nova-compute[75235]:     </system>
Nov 29 19:26:30 user nova-compute[75235]:   </sysinfo>
Nov 29 19:26:30 user nova-compute[75235]:   <os>
Nov 29 19:26:30 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:26:30 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:26:30 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:26:30 user nova-compute[75235]:   </os>
Nov 29 19:26:30 user nova-compute[75235]:   <features>
Nov 29 19:26:30 user nova-compute[75235]:     <acpi/>
Nov 29 19:26:30 user nova-compute[75235]:     <apic/>
Nov 29 19:26:30 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:26:30 user nova-compute[75235]:   </features>
Nov 29 19:26:30 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:26:30 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:26:30 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:26:30 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:26:30 user nova-compute[75235]:   </clock>
Nov 29 19:26:30 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:26:30 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:26:30 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:26:30 user nova-compute[75235]:   </cpu>
Nov 29 19:26:30 user nova-compute[75235]:   <devices>
Nov 29 19:26:30 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:26:30 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:26:30 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk"/>
Nov 29 19:26:30 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:26:30 user nova-compute[75235]:     </disk>
Nov 29 19:26:30 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:26:30 user nova-compute[75235]:       <mac address="fa:16:3e:47:97:b1"/>
Nov 29 19:26:30 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:26:30 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:26:30 user nova-compute[75235]:       <target dev="tap1068923c-1a"/>
Nov 29 19:26:30 user nova-compute[75235]:     </interface>
Nov 29 19:26:30 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:26:30 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/console.log" append="off"/>
Nov 29 19:26:30 user nova-compute[75235]:     </serial>
Nov 29 19:26:30 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:26:30 user nova-compute[75235]:     <video>
Nov 29 19:26:30 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:26:30 user nova-compute[75235]:     </video>
Nov 29 19:26:30 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:26:30 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:26:30 user nova-compute[75235]:     </rng>
Nov 29 19:26:30 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:26:30 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:26:30 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:26:30 user nova-compute[75235]:     </memballoon>
Nov 29 19:26:30 user nova-compute[75235]:   </devices>
Nov 29 19:26:30 user nova-compute[75235]: </domain>
Nov 29 19:26:30 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-828681369',display_name='tempest-VolumesSnapshotTestJSON-instance-828681369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-828681369',id=44,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSXjOk3QuLTs/zlg0MrKxAX3hRXhVM5JGcwrG3SYK5//APBCLfIj0qz5cN19RC1hGPyNaF2jUdDRyBknIaDgMNlCgERK3h/cgytg8htBkwTw8S75uljcM/+CKZ9AQektw==',key_name='tempest-keypair-309916703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ad88693560a465299e61e263c402de3',ramdisk_id='',reservation_id='r-y5fatmke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1975532199',owner_user_name='tempest-VolumesSnapshotTestJSON-1975532199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aec9d4541474364baae470f90efe2ea',uuid=35a58a85-65f9-45b8-a8a3-f69ecfad5295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converting VIF {"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG os_vif [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb571ff7-0a33-5f73-9df9-f915c8b038e7', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1068923c-1a, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1068923c-1a, col_values=(('qos', UUID('70f3aeb8-6b4c-42fd-9181-f219482e467a')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1068923c-1a, col_values=(('external_ids', {'iface-id': '1068923c-1a5a-4d34-9727-2f38755c7a26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:97:b1', 'vm-uuid': '35a58a85-65f9-45b8-a8a3-f69ecfad5295'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:30 user nova-compute[75235]: INFO os_vif [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a')
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No VIF found with MAC fa:16:3e:47:97:b1, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updated VIF entry in instance network info cache for port 1068923c-1a5a-4d34-9727-2f38755c7a26. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.network.neutron [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating instance_info_cache with network_info: [{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-1a32defb-edcf-4ea3-a436-ad4f3469528a req-a06943fa-733b-4889-a494-ac4e81bac6ba service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received event network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1a32defb-edcf-4ea3-a436-ad4f3469528a req-a06943fa-733b-4889-a494-ac4e81bac6ba service nova] Acquiring lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1a32defb-edcf-4ea3-a436-ad4f3469528a req-a06943fa-733b-4889-a494-ac4e81bac6ba service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1a32defb-edcf-4ea3-a436-ad4f3469528a req-a06943fa-733b-4889-a494-ac4e81bac6ba service nova] Lock "9d57cb98-5640-4104-ab59-fc0f4786433c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-1a32defb-edcf-4ea3-a436-ad4f3469528a req-a06943fa-733b-4889-a494-ac4e81bac6ba service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] No waiting events found dispatching network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:30 user nova-compute[75235]: WARNING nova.compute.manager [req-1a32defb-edcf-4ea3-a436-ad4f3469528a req-a06943fa-733b-4889-a494-ac4e81bac6ba service nova] [instance: 9d57cb98-5640-4104-ab59-fc0f4786433c] Received unexpected event network-vif-plugged-5f5671a6-9e9f-4e2b-9e46-dbd420e435d6 for instance with vm_state deleted and task_state None.
Nov 29 19:26:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-3f72802d-8fa9-4789-b4e8-94ba4e49f333 req-046c15dd-e203-4c55-8faf-a530ac0f5289 service nova] Releasing lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:26:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-d26d8f8b-9cdc-4201-b814-177da39b6b58 req-b794c4ac-0784-4943-8f90-b20966c23e8d service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d26d8f8b-9cdc-4201-b814-177da39b6b58 req-b794c4ac-0784-4943-8f90-b20966c23e8d service nova] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d26d8f8b-9cdc-4201-b814-177da39b6b58 req-b794c4ac-0784-4943-8f90-b20966c23e8d service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d26d8f8b-9cdc-4201-b814-177da39b6b58 req-b794c4ac-0784-4943-8f90-b20966c23e8d service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG nova.compute.manager [req-d26d8f8b-9cdc-4201-b814-177da39b6b58 req-b794c4ac-0784-4943-8f90-b20966c23e8d service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] No waiting events found dispatching network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:32 user nova-compute[75235]: WARNING nova.compute.manager [req-d26d8f8b-9cdc-4201-b814-177da39b6b58 req-b794c4ac-0784-4943-8f90-b20966c23e8d service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received unexpected event network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 for instance with vm_state building and task_state spawning.
Nov 29 19:26:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:33 user nova-compute[75235]: INFO nova.compute.manager [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Terminating instance
Nov 29 19:26:33 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-67f702b4-fb84-4f0e-918b-7876558c1c37 req-613d9266-8343-49f5-9683-fcb662bf205d service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-67f702b4-fb84-4f0e-918b-7876558c1c37 req-613d9266-8343-49f5-9683-fcb662bf205d service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-67f702b4-fb84-4f0e-918b-7876558c1c37 req-613d9266-8343-49f5-9683-fcb662bf205d service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-67f702b4-fb84-4f0e-918b-7876558c1c37 req-613d9266-8343-49f5-9683-fcb662bf205d service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-67f702b4-fb84-4f0e-918b-7876558c1c37 req-613d9266-8343-49f5-9683-fcb662bf205d service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-67f702b4-fb84-4f0e-918b-7876558c1c37 req-613d9266-8343-49f5-9683-fcb662bf205d service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-unplugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Instance spawned successfully.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Instance destroyed successfully.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lazy-loading 'resources' on Instance uuid 5380cf96-db98-487d-a6b5-bec6948e12a9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-977206923',display_name='tempest-ServerRescueNegativeTestJSON-server-977206923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-977206923',id=25,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77e6e9f44ec4c76b5c8f8f29c7e651f',ramdisk_id='',reservation_id='r-chnpghcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1726326315',owner_user_name='tempest-ServerRescueNegativeTestJSON-1726326315-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:16:16Z,user_data=None,user_id='b09701817c0147aca7432e1329b82300',uuid=5380cf96-db98-487d-a6b5-bec6948e12a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converting VIF {"id": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "address": "fa:16:3e:5d:71:d0", "network": {"id": "f62c3629-c91c-4c12-a5e1-eca1f4c6fed8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1454848405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77e6e9f44ec4c76b5c8f8f29c7e651f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85fc5c4f-5b", "ovs_interfaceid": "85fc5c4f-5bbb-4434-938a-560ee6fd2aaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG os_vif [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-8ee75645-a7e9-4357-b57e-0a820f5a07ab req-bf4eb39c-713f-4762-adcb-ddbd766f6160 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8ee75645-a7e9-4357-b57e-0a820f5a07ab req-bf4eb39c-713f-4762-adcb-ddbd766f6160 service nova] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8ee75645-a7e9-4357-b57e-0a820f5a07ab req-bf4eb39c-713f-4762-adcb-ddbd766f6160 service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-8ee75645-a7e9-4357-b57e-0a820f5a07ab req-bf4eb39c-713f-4762-adcb-ddbd766f6160 service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-8ee75645-a7e9-4357-b57e-0a820f5a07ab req-bf4eb39c-713f-4762-adcb-ddbd766f6160 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] No waiting events found dispatching network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:34 user nova-compute[75235]: WARNING nova.compute.manager [req-8ee75645-a7e9-4357-b57e-0a820f5a07ab req-bf4eb39c-713f-4762-adcb-ddbd766f6160 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received unexpected event network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 for instance with vm_state building and task_state spawning.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85fc5c4f-5b, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=535cbff5-a9cc-4fd6-a409-853fdf0b8b96) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:34 user nova-compute[75235]: INFO os_vif [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:71:d0,bridge_name='br-int',has_traffic_filtering=True,id=85fc5c4f-5bbb-4434-938a-560ee6fd2aaa,network=Network(f62c3629-c91c-4c12-a5e1-eca1f4c6fed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85fc5c4f-5b')
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Deleting instance files /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9_del
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Deletion of /opt/stack/data/nova/instances/5380cf96-db98-487d-a6b5-bec6948e12a9_del complete
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.compute.manager [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.compute.manager [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Took 6.56 seconds to build instance.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-50c0f883-b827-4b56-8a5d-5cfeccb0c3e2 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:34 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Took 0.51 seconds to deallocate network for instance.
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:35 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Deleted allocations for instance 5380cf96-db98-487d-a6b5-bec6948e12a9
Nov 29 19:26:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4cfce528-fafe-4c6b-901c-972859a7ea32 tempest-ServerRescueNegativeTestJSON-1726326315 tempest-ServerRescueNegativeTestJSON-1726326315-project-member] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-0ed96971-ab81-4019-b001-5d8ba5af1e20 req-2441f4b8-4f72-4072-8a09-f2fd6bd854dc service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0ed96971-ab81-4019-b001-5d8ba5af1e20 req-2441f4b8-4f72-4072-8a09-f2fd6bd854dc service nova] Acquiring lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0ed96971-ab81-4019-b001-5d8ba5af1e20 req-2441f4b8-4f72-4072-8a09-f2fd6bd854dc service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0ed96971-ab81-4019-b001-5d8ba5af1e20 req-2441f4b8-4f72-4072-8a09-f2fd6bd854dc service nova] Lock "5380cf96-db98-487d-a6b5-bec6948e12a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-0ed96971-ab81-4019-b001-5d8ba5af1e20 req-2441f4b8-4f72-4072-8a09-f2fd6bd854dc service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] No waiting events found dispatching network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:35 user nova-compute[75235]: WARNING nova.compute.manager [req-0ed96971-ab81-4019-b001-5d8ba5af1e20 req-2441f4b8-4f72-4072-8a09-f2fd6bd854dc service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received unexpected event network-vif-plugged-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa for instance with vm_state deleted and task_state None.
Nov 29 19:26:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-be2cb9fd-7baf-490b-820c-bd51a5e3df97 req-17930fc5-5513-40f0-8fcb-beb67d9dcf16 service nova] [instance: 5380cf96-db98-487d-a6b5-bec6948e12a9] Received event network-vif-deleted-85fc5c4f-5bbb-4434-938a-560ee6fd2aaa {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:58 user nova-compute[75235]: INFO nova.compute.manager [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Terminating instance
Nov 29 19:26:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fd55601-3d5d-459c-8b85-a07dc33353ce req-c2b432b7-0141-4cf9-805e-a880cac8e875 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-vif-unplugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fd55601-3d5d-459c-8b85-a07dc33353ce req-c2b432b7-0141-4cf9-805e-a880cac8e875 service nova] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fd55601-3d5d-459c-8b85-a07dc33353ce req-c2b432b7-0141-4cf9-805e-a880cac8e875 service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-5fd55601-3d5d-459c-8b85-a07dc33353ce req-c2b432b7-0141-4cf9-805e-a880cac8e875 service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fd55601-3d5d-459c-8b85-a07dc33353ce req-c2b432b7-0141-4cf9-805e-a880cac8e875 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] No waiting events found dispatching network-vif-unplugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:26:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-5fd55601-3d5d-459c-8b85-a07dc33353ce req-c2b432b7-0141-4cf9-805e-a880cac8e875 service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-vif-unplugged-8da32f1e-c2bc-43f9-842a-e65671964948 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Instance destroyed successfully.
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.objects.instance [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'resources' on Instance uuid 864ba3bb-968d-48a1-96d1-157a6f3feb18 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-31627254',display_name='tempest-TestVolumeBootPattern-volume-backed-server-31627254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-31627254',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhYpBGSeLF/GpH0ykGBpELv3UDvXEu/OQXFsAVAmbg7HIak/A/MIiROAQYlE+yv8xVcFda+MNeY2HdQG4kPbF+SZNOTMc8vzTWe7dCNZuQtcrq+8/iQK4RGIioy1BTbVw==',key_name='tempest-keypair-1797251563',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-gfl3prah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20d52323a014526b5ebd121d637f4c4',uuid=864ba3bb-968d-48a1-96d1-157a6f3feb18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "8da32f1e-c2bc-43f9-842a-e65671964948", "address": "fa:16:3e:8e:a3:2d", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da32f1e-c2", "ovs_interfaceid": "8da32f1e-c2bc-43f9-842a-e65671964948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_vif [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8da32f1e-c2, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a81b88d5-4f91-4d7f-a714-9b0a3e14b7d2) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:26:59 user nova-compute[75235]: INFO os_vif [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:a3:2d,bridge_name='br-int',has_traffic_filtering=True,id=8da32f1e-c2bc-43f9-842a-e65671964948,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da32f1e-c2')
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSEikvbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:26:59 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa8b4c6-a9e2-42e7-a7ef-6032be6a5072]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:26:59 user nova-compute[75235]: No targets found.
Nov 29 19:26:59 user nova-compute[75235]: iSNS:
Nov 29 19:26:59 user nova-compute[75235]: No targets found.
Nov 29 19:26:59 user nova-compute[75235]: STATIC:
Nov 29 19:26:59 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7
Nov 29 19:26:59 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:26:59 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:26:59 user nova-compute[75235]: FIRMWARE:
Nov 29 19:26:59 user nova-compute[75235]: No targets found.
Nov 29 19:26:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:26:59 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:26:59 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[849e0fe7-e556-43e7-9d6f-5a250d781cbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b6321-63d2-4e6c-b7c7-cb793d4b03a4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:26:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 (non-flash)
Nov 29 19:26:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5658393c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6e79e-3586-476c-aa15-b437eea4ee40]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3293cc-74c2-4ff1-b551-cb614d6856be]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe5abd-1efe-44e3-b62c-26fa579330f9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2901eefd-6751-408d-9cdd-3c3ec1914476]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_54911a9c', '/dev/disk/by-id/scsi-1SCST_BIO54911a9c-b751d642f8a400a1', '/dev/disk/by-id/scsi-26237353164363432') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff2442-7817-453f-8b5d-8f87f02a0baf]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d55d1-52d1-4ee9-b70a-a1e567eeda91]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb6d7c1-5bc1-4166-ae32-6c841c301acd]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260]
Nov 29 19:26:59 user nova-compute[75235]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7, portal: 172.16.0.220,3260] successful.
Nov 29 19:26:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff99555-9e3a-4e95-82a6-783254f134f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5721a8-7e64-4f72-a02d-40470f81f1a7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== disconnect_volume: return (298ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:26:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Deleting instance files /opt/stack/data/nova/instances/864ba3bb-968d-48a1-96d1-157a6f3feb18_del
Nov 29 19:26:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Deletion of /opt/stack/data/nova/instances/864ba3bb-968d-48a1-96d1-157a6f3feb18_del complete
Nov 29 19:26:59 user nova-compute[75235]: INFO nova.compute.manager [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 29 19:26:59 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:26:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:00 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:27:00 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Took 0.70 seconds to deallocate network for instance.
Nov 29 19:27:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:27:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] Acquiring lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] No waiting events found dispatching network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:27:00 user nova-compute[75235]: WARNING nova.compute.manager [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received unexpected event network-vif-plugged-8da32f1e-c2bc-43f9-842a-e65671964948 for instance with vm_state active and task_state deleting.
Nov 29 19:27:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-ffba174c-1cc5-4271-a179-1f8479165342 req-78cdd08a-7639-4a24-8373-bc1380f7007d service nova] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Received event network-vif-deleted-8da32f1e-c2bc-43f9-842a-e65671964948 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:27:01 user nova-compute[75235]: INFO nova.compute.manager [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Took 0.74 seconds to detach 1 volumes for instance.
Nov 29 19:27:01 user nova-compute[75235]: DEBUG nova.compute.manager [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 864ba3bb-968d-48a1-96d1-157a6f3feb18] Deleting volume: 7ff99555-9e3a-4e95-82a6-783254f134f7 {{(pid=75235) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 19:27:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:01 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:27:01 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:27:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:01 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Deleted allocations for instance 864ba3bb-968d-48a1-96d1-157a6f3feb18
Nov 29 19:27:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-461ffec8-1247-4c67-adaa-f44e16c01b2a tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "864ba3bb-968d-48a1-96d1-157a6f3feb18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.304s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:05 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:05 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:27:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.15658187866211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:10 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:11 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:11 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:11 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:27:12 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:27:13 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating instance_info_cache with network_info: [{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:27:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:27:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:27:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:27:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:27:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:27:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:27:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:29 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:27:32 user nova-compute[75235]: INFO nova.compute.claims [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Claim successful on node user
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:27:32 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:27:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.policy [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c44ac18976b4232a45bedacf9177023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2594a91424a6408a9c6c57d5364bc9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:27:33 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Creating image(s)
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk 1073741824" returned: 0 in 0.060s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Cannot resize image /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Ensure instance console log exists: /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Successfully created port: 2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Successfully updated port: 2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquired lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-changed-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG nova.compute.manager [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Refreshing instance network info cache due to event network-changed-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] Acquiring lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG nova.network.neutron [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:27:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.neutron [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating instance_info_cache with network_info: [{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Releasing lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Instance network_info: |[{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] Acquired lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.neutron [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Refreshing network info cache for port 2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Start _get_guest_xml network_info=[{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:27:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:27:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-611547369',display_name='tempest-AttachVolumeNegativeTest-server-611547369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-611547369',id=45,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9dnfQ02e7RNR+qCoeWVJvcBI46ruh49FtR918F9dLRnb2PURrs7xOQ9aKOenPZ5dOMip7Mynq0KwUtFm/CzttMbRclueWsqmojmgl+0oUDmRetx7OHjuEkgvUvOk9ZUQ==',key_name='tempest-keypair-2052833185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-aca81tnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=f5f6210e-b04f-4920-9285-5177f5c2cada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.objects.instance [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'pci_devices' on Instance uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:27:35 user nova-compute[75235]:   <uuid>f5f6210e-b04f-4920-9285-5177f5c2cada</uuid>
Nov 29 19:27:35 user nova-compute[75235]:   <name>instance-0000002d</name>
Nov 29 19:27:35 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:27:35 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:27:35 user nova-compute[75235]:   <metadata>
Nov 29 19:27:35 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:27:35 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:27:35 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeNegativeTest-server-611547369</nova:name>
Nov 29 19:27:35 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:27:35</nova:creationTime>
Nov 29 19:27:35 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:27:35 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:27:35 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:27:35 user nova-compute[75235]:       <nova:owner>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:user uuid="4c44ac18976b4232a45bedacf9177023">tempest-AttachVolumeNegativeTest-1078373175-project-member</nova:user>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:project uuid="2594a91424a6408a9c6c57d5364bc9bb">tempest-AttachVolumeNegativeTest-1078373175</nova:project>
Nov 29 19:27:35 user nova-compute[75235]:       </nova:owner>
Nov 29 19:27:35 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:27:35 user nova-compute[75235]:       <nova:ports>
Nov 29 19:27:35 user nova-compute[75235]:         <nova:port uuid="2dc53f98-6cde-4e3d-9f55-cf9234cb99a9">
Nov 29 19:27:35 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 19:27:35 user nova-compute[75235]:         </nova:port>
Nov 29 19:27:35 user nova-compute[75235]:       </nova:ports>
Nov 29 19:27:35 user nova-compute[75235]:     </nova:instance>
Nov 29 19:27:35 user nova-compute[75235]:   </metadata>
Nov 29 19:27:35 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:27:35 user nova-compute[75235]:     <system>
Nov 29 19:27:35 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:27:35 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:27:35 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:27:35 user nova-compute[75235]:       <entry name="serial">f5f6210e-b04f-4920-9285-5177f5c2cada</entry>
Nov 29 19:27:35 user nova-compute[75235]:       <entry name="uuid">f5f6210e-b04f-4920-9285-5177f5c2cada</entry>
Nov 29 19:27:35 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:27:35 user nova-compute[75235]:     </system>
Nov 29 19:27:35 user nova-compute[75235]:   </sysinfo>
Nov 29 19:27:35 user nova-compute[75235]:   <os>
Nov 29 19:27:35 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:27:35 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:27:35 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:27:35 user nova-compute[75235]:   </os>
Nov 29 19:27:35 user nova-compute[75235]:   <features>
Nov 29 19:27:35 user nova-compute[75235]:     <acpi/>
Nov 29 19:27:35 user nova-compute[75235]:     <apic/>
Nov 29 19:27:35 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:27:35 user nova-compute[75235]:   </features>
Nov 29 19:27:35 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:27:35 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:27:35 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:27:35 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:27:35 user nova-compute[75235]:   </clock>
Nov 29 19:27:35 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:27:35 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:27:35 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:27:35 user nova-compute[75235]:   </cpu>
Nov 29 19:27:35 user nova-compute[75235]:   <devices>
Nov 29 19:27:35 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:27:35 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:27:35 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk"/>
Nov 29 19:27:35 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:27:35 user nova-compute[75235]:     </disk>
Nov 29 19:27:35 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:27:35 user nova-compute[75235]:       <mac address="fa:16:3e:87:38:f9"/>
Nov 29 19:27:35 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:27:35 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:27:35 user nova-compute[75235]:       <target dev="tap2dc53f98-6c"/>
Nov 29 19:27:35 user nova-compute[75235]:     </interface>
Nov 29 19:27:35 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:27:35 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/console.log" append="off"/>
Nov 29 19:27:35 user nova-compute[75235]:     </serial>
Nov 29 19:27:35 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:27:35 user nova-compute[75235]:     <video>
Nov 29 19:27:35 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:27:35 user nova-compute[75235]:     </video>
Nov 29 19:27:35 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:27:35 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:27:35 user nova-compute[75235]:     </rng>
Nov 29 19:27:35 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:27:35 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:27:35 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:27:35 user nova-compute[75235]:     </memballoon>
Nov 29 19:27:35 user nova-compute[75235]:   </devices>
Nov 29 19:27:35 user nova-compute[75235]: </domain>
Nov 29 19:27:35 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-611547369',display_name='tempest-AttachVolumeNegativeTest-server-611547369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-611547369',id=45,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9dnfQ02e7RNR+qCoeWVJvcBI46ruh49FtR918F9dLRnb2PURrs7xOQ9aKOenPZ5dOMip7Mynq0KwUtFm/CzttMbRclueWsqmojmgl+0oUDmRetx7OHjuEkgvUvOk9ZUQ==',key_name='tempest-keypair-2052833185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-aca81tnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=f5f6210e-b04f-4920-9285-5177f5c2cada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG os_vif [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4853f89b-52b4-51ac-a880-51d95e88f365', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dc53f98-6c, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dc53f98-6c, col_values=(('qos', UUID('7571c24d-b94e-49b9-89b7-56e5c4561392')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dc53f98-6c, col_values=(('external_ids', {'iface-id': '2dc53f98-6cde-4e3d-9f55-cf9234cb99a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:38:f9', 'vm-uuid': 'f5f6210e-b04f-4920-9285-5177f5c2cada'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:35 user nova-compute[75235]: INFO os_vif [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c')
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:87:38:f9, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.neutron [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updated VIF entry in instance network info cache for port 2dc53f98-6cde-4e3d-9f55-cf9234cb99a9. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG nova.network.neutron [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating instance_info_cache with network_info: [{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:27:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-27923b4e-d57d-4d4d-9bf4-a1d18d5610fe req-fed1183a-afd2-4967-9a8f-360e4caeda32 service nova] Releasing lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-893af0fc-1f95-4c93-9c5a-a2acae4a5b14 req-a9c7101b-7925-4f7a-8942-487abb404ab9 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-893af0fc-1f95-4c93-9c5a-a2acae4a5b14 req-a9c7101b-7925-4f7a-8942-487abb404ab9 service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-893af0fc-1f95-4c93-9c5a-a2acae4a5b14 req-a9c7101b-7925-4f7a-8942-487abb404ab9 service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-893af0fc-1f95-4c93-9c5a-a2acae4a5b14 req-a9c7101b-7925-4f7a-8942-487abb404ab9 service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-893af0fc-1f95-4c93-9c5a-a2acae4a5b14 req-a9c7101b-7925-4f7a-8942-487abb404ab9 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:27:36 user nova-compute[75235]: WARNING nova.compute.manager [req-893af0fc-1f95-4c93-9c5a-a2acae4a5b14 req-a9c7101b-7925-4f7a-8942-487abb404ab9 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received unexpected event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with vm_state building and task_state spawning.
Nov 29 19:27:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:27:38 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Instance spawned successfully.
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-14390bf0-8695-4747-9eed-e078c327e252 req-e9439b12-d92e-40aa-9c97-b1a8afedb246 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-14390bf0-8695-4747-9eed-e078c327e252 req-e9439b12-d92e-40aa-9c97-b1a8afedb246 service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-14390bf0-8695-4747-9eed-e078c327e252 req-e9439b12-d92e-40aa-9c97-b1a8afedb246 service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-14390bf0-8695-4747-9eed-e078c327e252 req-e9439b12-d92e-40aa-9c97-b1a8afedb246 service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-14390bf0-8695-4747-9eed-e078c327e252 req-e9439b12-d92e-40aa-9c97-b1a8afedb246 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:27:38 user nova-compute[75235]: WARNING nova.compute.manager [req-14390bf0-8695-4747-9eed-e078c327e252 req-e9439b12-d92e-40aa-9c97-b1a8afedb246 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received unexpected event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with vm_state building and task_state spawning.
Nov 29 19:27:38 user nova-compute[75235]: INFO nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 29 19:27:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:27:39 user nova-compute[75235]: INFO nova.compute.manager [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Took 6.74 seconds to build instance.
Nov 29 19:27:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-801f0c9e-de65-4aa3-b6fe-ef68e72ee165 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.844s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:27:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:27:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:27:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:27:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:27:59 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:27:59 user nova-compute[75235]: INFO nova.compute.claims [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Claim successful on node user
Nov 29 19:27:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:28:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:28:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.policy [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20d52323a014526b5ebd121d637f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e15c428b2f43b9a2e5850370c4f938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:28:00 user nova-compute[75235]: INFO nova.virt.block_device [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Booting with volume 7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b at /dev/vda
Nov 29 19:28:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2760cdee-163e-49d2-8e29-b397bf77802f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640611d-479e-48d9-8814-20b9c700f48a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71701af-6d4d-4d30-ab92-50ac74187d76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5cc70-435f-4953-804e-93875e918f50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:28:00 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:28:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ea3ef-e5e9-451b-9ae7-7c0303443f12]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:28:00 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updating existing volume attachment record: 5a2f4f97-1c70-4ebb-87ee-734c19e68ab4 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Successfully created port: 532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Successfully updated port: 532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquired lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-changed-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Refreshing instance network info cache due to event network-changed-532ab5e9-6ea8-4740-9a8b-6af34beff956. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] Acquiring lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:28:01 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG nova.network.neutron [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updating instance_info_cache with network_info: [{"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Releasing lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Instance network_info: |[{"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] Acquired lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Refreshing network info cache for port 532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updated VIF entry in instance network info cache for port 532ab5e9-6ea8-4740-9a8b-6af34beff956. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG nova.network.neutron [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updating instance_info_cache with network_info: [{"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:28:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d39ef8df-e7aa-426a-ba2d-b0abb41e9690 req-7525882c-9965-48a9-ba1f-b42ef30651c0 service nova] Releasing lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:28:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:28:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Creating image(s)
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Ensure instance console log exists: /opt/stack/data/nova/instances/28bafdff-f4f0-4dae-915b-8831ffdcd6b9/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Start _get_guest_xml network_info=[{"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '5a2f4f97-1c70-4ebb-87ee-734c19e68ab4', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28bafdff-f4f0-4dae-915b-8831ffdcd6b9', 'attached_at': '', 'detached_at': '', 'volume_id': '7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'serial': '7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:28:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:28:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:28:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:28:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:28:08 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c4746-4fe5-46fa-a84c-5c85f646fba5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:28:08 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c040a-17d9-4758-9a52-cce327440964]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b] added
Nov 29 19:28:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6661fa-dcc6-4229-89b2-25502e694147]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d144e2c7-7486-4d91-b2f2-3b7dcd47b538]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRGulkqw {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRGulkqw" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b797d4e-f262-497a-98ce-397c0d4a4a74]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRGulkqw'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4039def-f477-438b-ac98-fa6e1c53f27a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4795be-7169-4322-a660-3133f78d79e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:28:08 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:28:08 user nova-compute[75235]:  {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:28:08 user nova-compute[75235]: WARNING os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 19:28:08 user nova-compute[75235]: 
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c503e-bc45-44d7-90a0-5aa080be074f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]
Nov 29 19:28:08 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.
Nov 29 19:28:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1788f9-db04-41d7-aadc-3baeb085bb63]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fd6069-0036-4a1e-adf2-fbf2f30b01f8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:28:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:28:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07748c2-6cde-4fcd-8c52-84a26f551150]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26230633330613130', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230633330613130', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487695319',display_name='tempest-TestVolumeBootPattern-server-487695319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487695319',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-0gygeno8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:28:00Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=28bafdff-f4f0-4dae-915b-8831ffdcd6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'pci_devices' on Instance uuid 28bafdff-f4f0-4dae-915b-8831ffdcd6b9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:28:09 user nova-compute[75235]:   <uuid>28bafdff-f4f0-4dae-915b-8831ffdcd6b9</uuid>
Nov 29 19:28:09 user nova-compute[75235]:   <name>instance-0000002e</name>
Nov 29 19:28:09 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:28:09 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:28:09 user nova-compute[75235]:   <metadata>
Nov 29 19:28:09 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:28:09 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:28:09 user nova-compute[75235]:       <nova:name>tempest-TestVolumeBootPattern-server-487695319</nova:name>
Nov 29 19:28:09 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:28:08</nova:creationTime>
Nov 29 19:28:09 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:28:09 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:28:09 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:28:09 user nova-compute[75235]:       <nova:owner>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:user uuid="f20d52323a014526b5ebd121d637f4c4">tempest-TestVolumeBootPattern-656128499-project-member</nova:user>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:project uuid="87e15c428b2f43b9a2e5850370c4f938">tempest-TestVolumeBootPattern-656128499</nova:project>
Nov 29 19:28:09 user nova-compute[75235]:       </nova:owner>
Nov 29 19:28:09 user nova-compute[75235]:       <nova:ports>
Nov 29 19:28:09 user nova-compute[75235]:         <nova:port uuid="532ab5e9-6ea8-4740-9a8b-6af34beff956">
Nov 29 19:28:09 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 19:28:09 user nova-compute[75235]:         </nova:port>
Nov 29 19:28:09 user nova-compute[75235]:       </nova:ports>
Nov 29 19:28:09 user nova-compute[75235]:     </nova:instance>
Nov 29 19:28:09 user nova-compute[75235]:   </metadata>
Nov 29 19:28:09 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:28:09 user nova-compute[75235]:     <system>
Nov 29 19:28:09 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:28:09 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:28:09 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:28:09 user nova-compute[75235]:       <entry name="serial">28bafdff-f4f0-4dae-915b-8831ffdcd6b9</entry>
Nov 29 19:28:09 user nova-compute[75235]:       <entry name="uuid">28bafdff-f4f0-4dae-915b-8831ffdcd6b9</entry>
Nov 29 19:28:09 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:28:09 user nova-compute[75235]:     </system>
Nov 29 19:28:09 user nova-compute[75235]:   </sysinfo>
Nov 29 19:28:09 user nova-compute[75235]:   <os>
Nov 29 19:28:09 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:28:09 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:28:09 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:28:09 user nova-compute[75235]:   </os>
Nov 29 19:28:09 user nova-compute[75235]:   <features>
Nov 29 19:28:09 user nova-compute[75235]:     <acpi/>
Nov 29 19:28:09 user nova-compute[75235]:     <apic/>
Nov 29 19:28:09 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:28:09 user nova-compute[75235]:   </features>
Nov 29 19:28:09 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:28:09 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:28:09 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:28:09 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:28:09 user nova-compute[75235]:   </clock>
Nov 29 19:28:09 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:28:09 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:28:09 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:28:09 user nova-compute[75235]:   </cpu>
Nov 29 19:28:09 user nova-compute[75235]:   <devices>
Nov 29 19:28:09 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:28:09 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:28:09 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:28:09 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:28:09 user nova-compute[75235]:       <serial>7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b</serial>
Nov 29 19:28:09 user nova-compute[75235]:     </disk>
Nov 29 19:28:09 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:28:09 user nova-compute[75235]:       <mac address="fa:16:3e:93:76:fc"/>
Nov 29 19:28:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:28:09 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:28:09 user nova-compute[75235]:       <target dev="tap532ab5e9-6e"/>
Nov 29 19:28:09 user nova-compute[75235]:     </interface>
Nov 29 19:28:09 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:28:09 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/28bafdff-f4f0-4dae-915b-8831ffdcd6b9/console.log" append="off"/>
Nov 29 19:28:09 user nova-compute[75235]:     </serial>
Nov 29 19:28:09 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:28:09 user nova-compute[75235]:     <video>
Nov 29 19:28:09 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:28:09 user nova-compute[75235]:     </video>
Nov 29 19:28:09 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:28:09 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:28:09 user nova-compute[75235]:     </rng>
Nov 29 19:28:09 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:28:09 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:28:09 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:28:09 user nova-compute[75235]:     </memballoon>
Nov 29 19:28:09 user nova-compute[75235]:   </devices>
Nov 29 19:28:09 user nova-compute[75235]: </domain>
Nov 29 19:28:09 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487695319',display_name='tempest-TestVolumeBootPattern-server-487695319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487695319',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-0gygeno8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:28:00Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=28bafdff-f4f0-4dae-915b-8831ffdcd6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG os_vif [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aef03f39-4efe-57b8-81ee-fe1a74fae88e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap532ab5e9-6e, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap532ab5e9-6e, col_values=(('qos', UUID('8130fa60-c5ea-4e5e-ae97-8fcdae430beb')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap532ab5e9-6e, col_values=(('external_ids', {'iface-id': '532ab5e9-6ea8-4740-9a8b-6af34beff956', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:76:fc', 'vm-uuid': '28bafdff-f4f0-4dae-915b-8831ffdcd6b9'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: INFO os_vif [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e')
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:28:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No VIF found with MAC fa:16:3e:93:76:fc, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:28:10 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:28:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=25.115455627441406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f5f6210e-b04f-4920-9285-5177f5c2cada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 28bafdff-f4f0-4dae-915b-8831ffdcd6b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-0fd2fa0c-5de8-470c-b19a-7988278c7081 req-a213b587-42be-4c2c-a4db-b2d45426e891 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fd2fa0c-5de8-470c-b19a-7988278c7081 req-a213b587-42be-4c2c-a4db-b2d45426e891 service nova] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fd2fa0c-5de8-470c-b19a-7988278c7081 req-a213b587-42be-4c2c-a4db-b2d45426e891 service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0fd2fa0c-5de8-470c-b19a-7988278c7081 req-a213b587-42be-4c2c-a4db-b2d45426e891 service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG nova.compute.manager [req-0fd2fa0c-5de8-470c-b19a-7988278c7081 req-a213b587-42be-4c2c-a4db-b2d45426e891 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] No waiting events found dispatching network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:28:11 user nova-compute[75235]: WARNING nova.compute.manager [req-0fd2fa0c-5de8-470c-b19a-7988278c7081 req-a213b587-42be-4c2c-a4db-b2d45426e891 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received unexpected event network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 for instance with vm_state building and task_state spawning.
Nov 29 19:28:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:28:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Instance spawned successfully.
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:13 user nova-compute[75235]: INFO nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:28:13 user nova-compute[75235]: INFO nova.compute.manager [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Took 13.76 seconds to build instance.
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-32d3d7cc-be6d-4aaa-9ddc-c4dd281d2b27 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.863s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-00097c43-e131-4779-a825-d2ab7d384441 req-d2cf337e-76f5-461f-938e-4da4020799d9 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-00097c43-e131-4779-a825-d2ab7d384441 req-d2cf337e-76f5-461f-938e-4da4020799d9 service nova] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-00097c43-e131-4779-a825-d2ab7d384441 req-d2cf337e-76f5-461f-938e-4da4020799d9 service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-00097c43-e131-4779-a825-d2ab7d384441 req-d2cf337e-76f5-461f-938e-4da4020799d9 service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:13 user nova-compute[75235]: DEBUG nova.compute.manager [req-00097c43-e131-4779-a825-d2ab7d384441 req-d2cf337e-76f5-461f-938e-4da4020799d9 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] No waiting events found dispatching network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:28:13 user nova-compute[75235]: WARNING nova.compute.manager [req-00097c43-e131-4779-a825-d2ab7d384441 req-d2cf337e-76f5-461f-938e-4da4020799d9 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received unexpected event network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 for instance with vm_state active and task_state None.
Nov 29 19:28:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:15 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating instance_info_cache with network_info: [{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:28:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:28:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:28:16 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:16 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:28:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-changed-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.compute.manager [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Refreshing instance network info cache due to event network-changed-1068923c-1a5a-4d34-9727-2f38755c7a26. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] Acquiring lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] Acquired lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Refreshing network info cache for port 1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'flavor' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:28:19 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Ignoring supplied device name: /dev/vdb
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:19 user nova-compute[75235]: INFO nova.compute.manager [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Attaching volume 34d8ff5d-ebf1-4059-a529-5449720d8df8 to /dev/vdb
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updated VIF entry in instance network info cache for port 1068923c-1a5a-4d34-9727-2f38755c7a26. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.network.neutron [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating instance_info_cache with network_info: [{"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6c793418-c3e7-4536-a525-d0afa532813e req-25a91cbb-9977-403b-b306-4f250f3d4c34 service nova] Releasing lock "refresh_cache-35a58a85-65f9-45b8-a8a3-f69ecfad5295" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG os_brick.utils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[421c31ae-8805-43e1-8f3a-640dc273da56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee074d-295e-46f1-b943-736b66d6a352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0416b45-62f8-43d9-9493-de245f4f072c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f682a1-c2ac-4450-aec6-627486bd52af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:28:19 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:28:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd2b00-3be9-40d5-8405-53005011c004]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG os_brick.utils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating existing volume attachment record: 7f4aecba-ad4d-450b-889e-1a4e4d842bc5 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:28:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxljQrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:28:29 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:28:29 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:28:29 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03453f7-d1f1-470c-8717-0e40b69d0ec4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:28:29 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f483b3-f138-4c4e-b09a-f4b52e05aaf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8] added
Nov 29 19:28:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecb54db-4875-466e-a9c3-d463fde3eca0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc39e2-8949-4aa2-88d2-42811fa10414]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxljQrSU {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxljQrSU" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c835e3-b6d1-4355-a153-bd87c147eb90]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxljQrSU'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9270f427-9a2b-4c94-8be4-81345d3068d5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd2775-ac2e-420f-a15c-d8f4f1356cf8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:28:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:28:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:28:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c266b836-da17-49b6-8014-33c51c4505af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260]
Nov 29 19:28:30 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260] successful.
Nov 29 19:28:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf69651-ede8-42b0-a091-67e0f7ed3458]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff6803-e6c4-4864-9ded-b6e49b8457bd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:28:30 user nova-compute[75235]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 (non-flash)
Nov 29 19:28:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:28:30 user nova-compute[75235]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 (non-flash)
Nov 29 19:28:30 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072f96b-15dd-40b9-9807-19668b82b5d9]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxljQrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:28:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23530346164656163', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530346164656163', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'flavor' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:28:31 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:28:31 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:28:31 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:28:31 user nova-compute[75235]:   <serial>34d8ff5d-ebf1-4059-a529-5449720d8df8</serial>
Nov 29 19:28:31 user nova-compute[75235]: </disk>
Nov 29 19:28:31 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] No VIF found with MAC fa:16:3e:47:97:b1, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:28:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4bba8355-2bfb-40b7-80ab-c72b6047319f tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.088s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:28:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:35 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:28:35 user nova-compute[75235]: INFO nova.compute.claims [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Claim successful on node user
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:28:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.policy [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '134c6c3f87274be199bd0b8ceca00d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a50bf29a3f347469ff3882b7e838ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:28:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Creating image(s)
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "/opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "/opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "/opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.220s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.208s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk 1073741824" returned: 0 in 0.064s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:36 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.227s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Cannot resize image /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Ensure instance console log exists: /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:37 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Successfully created port: 03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Successfully updated port: 03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquired lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-changed-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Refreshing instance network info cache due to event network-changed-03dc0728-2b84-4329-86a3-5ba3313242ac. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] Acquiring lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Releasing lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Instance network_info: |[{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] Acquired lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Refreshing network info cache for port 03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Start _get_guest_xml network_info=[{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:28:38 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:28:38 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:28:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1465187311',display_name='tempest-SnapshotDataIntegrityTests-server-1465187311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1465187311',id=47,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7cGyiyNKxiQMbSv/W37pEl/KvUyc8b7ng6GL6wpaeRY5rqEr7TDIIXwiL2D4kK9dJ3jVSCE2mYDVi9tOQY15+m2OzyvnNQto8o0Ez0iWKZ3yCP3c3hMkBFqsOZ+nQidw==',key_name='tempest-keypair-2082130585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a50bf29a3f347469ff3882b7e838ebb',ramdisk_id='',reservation_id='r-ss5nkjqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-583910208',owner_user_name='tempest-SnapshotDataIntegrityTests-583910208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='134c6c3f87274be199bd0b8ceca00d5f',uuid=1781069c-646e-439c-a4b6-583e11a56b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Converting VIF {"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.objects.instance [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'pci_devices' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:28:38 user nova-compute[75235]:   <uuid>1781069c-646e-439c-a4b6-583e11a56b50</uuid>
Nov 29 19:28:38 user nova-compute[75235]:   <name>instance-0000002f</name>
Nov 29 19:28:38 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:28:38 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:28:38 user nova-compute[75235]:   <metadata>
Nov 29 19:28:38 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:28:38 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:28:38 user nova-compute[75235]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1465187311</nova:name>
Nov 29 19:28:38 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:28:38</nova:creationTime>
Nov 29 19:28:38 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:28:38 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:28:38 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:28:38 user nova-compute[75235]:       <nova:owner>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:user uuid="134c6c3f87274be199bd0b8ceca00d5f">tempest-SnapshotDataIntegrityTests-583910208-project-member</nova:user>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:project uuid="1a50bf29a3f347469ff3882b7e838ebb">tempest-SnapshotDataIntegrityTests-583910208</nova:project>
Nov 29 19:28:38 user nova-compute[75235]:       </nova:owner>
Nov 29 19:28:38 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:28:38 user nova-compute[75235]:       <nova:ports>
Nov 29 19:28:38 user nova-compute[75235]:         <nova:port uuid="03dc0728-2b84-4329-86a3-5ba3313242ac">
Nov 29 19:28:38 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 19:28:38 user nova-compute[75235]:         </nova:port>
Nov 29 19:28:38 user nova-compute[75235]:       </nova:ports>
Nov 29 19:28:38 user nova-compute[75235]:     </nova:instance>
Nov 29 19:28:38 user nova-compute[75235]:   </metadata>
Nov 29 19:28:38 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:28:38 user nova-compute[75235]:     <system>
Nov 29 19:28:38 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:28:38 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:28:38 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:28:38 user nova-compute[75235]:       <entry name="serial">1781069c-646e-439c-a4b6-583e11a56b50</entry>
Nov 29 19:28:38 user nova-compute[75235]:       <entry name="uuid">1781069c-646e-439c-a4b6-583e11a56b50</entry>
Nov 29 19:28:38 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:28:38 user nova-compute[75235]:     </system>
Nov 29 19:28:38 user nova-compute[75235]:   </sysinfo>
Nov 29 19:28:38 user nova-compute[75235]:   <os>
Nov 29 19:28:38 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:28:38 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:28:38 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:28:38 user nova-compute[75235]:   </os>
Nov 29 19:28:38 user nova-compute[75235]:   <features>
Nov 29 19:28:38 user nova-compute[75235]:     <acpi/>
Nov 29 19:28:38 user nova-compute[75235]:     <apic/>
Nov 29 19:28:38 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:28:38 user nova-compute[75235]:   </features>
Nov 29 19:28:38 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:28:38 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:28:38 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:28:38 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:28:38 user nova-compute[75235]:   </clock>
Nov 29 19:28:38 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:28:38 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:28:38 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:28:38 user nova-compute[75235]:   </cpu>
Nov 29 19:28:38 user nova-compute[75235]:   <devices>
Nov 29 19:28:38 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:28:38 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:28:38 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk"/>
Nov 29 19:28:38 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:28:38 user nova-compute[75235]:     </disk>
Nov 29 19:28:38 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:28:38 user nova-compute[75235]:       <mac address="fa:16:3e:58:22:e3"/>
Nov 29 19:28:38 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:28:38 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:28:38 user nova-compute[75235]:       <target dev="tap03dc0728-2b"/>
Nov 29 19:28:38 user nova-compute[75235]:     </interface>
Nov 29 19:28:38 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:28:38 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/console.log" append="off"/>
Nov 29 19:28:38 user nova-compute[75235]:     </serial>
Nov 29 19:28:38 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:28:38 user nova-compute[75235]:     <video>
Nov 29 19:28:38 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:28:38 user nova-compute[75235]:     </video>
Nov 29 19:28:38 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:28:38 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:28:38 user nova-compute[75235]:     </rng>
Nov 29 19:28:38 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:28:38 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:28:38 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:28:38 user nova-compute[75235]:     </memballoon>
Nov 29 19:28:38 user nova-compute[75235]:   </devices>
Nov 29 19:28:38 user nova-compute[75235]: </domain>
Nov 29 19:28:38 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:28:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1465187311',display_name='tempest-SnapshotDataIntegrityTests-server-1465187311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1465187311',id=47,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7cGyiyNKxiQMbSv/W37pEl/KvUyc8b7ng6GL6wpaeRY5rqEr7TDIIXwiL2D4kK9dJ3jVSCE2mYDVi9tOQY15+m2OzyvnNQto8o0Ez0iWKZ3yCP3c3hMkBFqsOZ+nQidw==',key_name='tempest-keypair-2082130585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a50bf29a3f347469ff3882b7e838ebb',ramdisk_id='',reservation_id='r-ss5nkjqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-583910208',owner_user_name='tempest-SnapshotDataIntegrityTests-583910208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='134c6c3f87274be199bd0b8ceca00d5f',uuid=1781069c-646e-439c-a4b6-583e11a56b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Converting VIF {"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG os_vif [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a52efdf3-957f-50c6-b8ce-a1cb65e000ce', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03dc0728-2b, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03dc0728-2b, col_values=(('qos', UUID('e6dcc33a-81e5-42d4-98be-c752814b5853')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03dc0728-2b, col_values=(('external_ids', {'iface-id': '03dc0728-2b84-4329-86a3-5ba3313242ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:22:e3', 'vm-uuid': '1781069c-646e-439c-a4b6-583e11a56b50'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:38 user nova-compute[75235]: INFO os_vif [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b')
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No VIF found with MAC fa:16:3e:58:22:e3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updated VIF entry in instance network info cache for port 03dc0728-2b84-4329-86a3-5ba3313242ac. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:28:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:28:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-02bab0d8-6bcb-45ae-a3b8-dbc8857f4d13 req-21723589-66e5-42c7-9e7a-d94a0d843458 service nova] Releasing lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:28:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-d1beaa36-2422-4110-a731-8cdbce5d2f87 req-14866ffe-ca79-4892-8f84-d72699d38bc4 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d1beaa36-2422-4110-a731-8cdbce5d2f87 req-14866ffe-ca79-4892-8f84-d72699d38bc4 service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d1beaa36-2422-4110-a731-8cdbce5d2f87 req-14866ffe-ca79-4892-8f84-d72699d38bc4 service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d1beaa36-2422-4110-a731-8cdbce5d2f87 req-14866ffe-ca79-4892-8f84-d72699d38bc4 service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-d1beaa36-2422-4110-a731-8cdbce5d2f87 req-14866ffe-ca79-4892-8f84-d72699d38bc4 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:28:40 user nova-compute[75235]: WARNING nova.compute.manager [req-d1beaa36-2422-4110-a731-8cdbce5d2f87 req-14866ffe-ca79-4892-8f84-d72699d38bc4 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state building and task_state spawning.
Nov 29 19:28:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:28:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Instance spawned successfully.
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.compute.manager [req-d34db33e-3754-4ad5-ac6b-cf347a1d0bd2 req-a025a4a7-83a4-486d-a418-920e539d5de5 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d34db33e-3754-4ad5-ac6b-cf347a1d0bd2 req-a025a4a7-83a4-486d-a418-920e539d5de5 service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d34db33e-3754-4ad5-ac6b-cf347a1d0bd2 req-a025a4a7-83a4-486d-a418-920e539d5de5 service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d34db33e-3754-4ad5-ac6b-cf347a1d0bd2 req-a025a4a7-83a4-486d-a418-920e539d5de5 service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.compute.manager [req-d34db33e-3754-4ad5-ac6b-cf347a1d0bd2 req-a025a4a7-83a4-486d-a418-920e539d5de5 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:28:42 user nova-compute[75235]: WARNING nova.compute.manager [req-d34db33e-3754-4ad5-ac6b-cf347a1d0bd2 req-a025a4a7-83a4-486d-a418-920e539d5de5 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state building and task_state spawning.
Nov 29 19:28:42 user nova-compute[75235]: INFO nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 29 19:28:42 user nova-compute[75235]: DEBUG nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:28:42 user nova-compute[75235]: INFO nova.compute.manager [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Took 6.69 seconds to build instance.
Nov 29 19:28:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-8d74ebf0-38c2-4ceb-b6b4-c40965896373 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.831s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:28:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:28:54 user nova-compute[75235]: INFO nova.compute.manager [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Detaching volume 34d8ff5d-ebf1-4059-a529-5449720d8df8
Nov 29 19:28:54 user nova-compute[75235]: INFO nova.virt.block_device [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Attempting to driver detach volume 34d8ff5d-ebf1-4059-a529-5449720d8df8 from mountpoint /dev/vdb
Nov 29 19:28:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Attempting to detach device vdb from instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:28:54 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:28:54 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:28:54 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:28:54 user nova-compute[75235]:   <serial>34d8ff5d-ebf1-4059-a529-5449720d8df8</serial>
Nov 29 19:28:54 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:28:54 user nova-compute[75235]: </disk>
Nov 29 19:28:54 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:28:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully detached device vdb from instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 from the persistent domain config.
Nov 29 19:28:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:28:54 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:28:54 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:28:54 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:28:54 user nova-compute[75235]:   <serial>34d8ff5d-ebf1-4059-a529-5449720d8df8</serial>
Nov 29 19:28:54 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:28:54 user nova-compute[75235]: </disk>
Nov 29 19:28:54 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:28:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:28:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:11 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:12 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:29:12 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=25.08324432373047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f5f6210e-b04f-4920-9285-5177f5c2cada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 28bafdff-f4f0-4dae-915b-8831ffdcd6b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:29:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 is timed out.
Nov 29 19:29:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully detached device vdb from instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295 from the live domain config.
Nov 29 19:29:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxljQrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:29:14 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba2b9e5-5ecc-461e-b86d-329e51e9993b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:29:14 user nova-compute[75235]: No targets found.
Nov 29 19:29:14 user nova-compute[75235]: iSNS:
Nov 29 19:29:14 user nova-compute[75235]: No targets found.
Nov 29 19:29:14 user nova-compute[75235]: STATIC:
Nov 29 19:29:14 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8
Nov 29 19:29:14 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:29:14 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:29:14 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:29:14 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:29:14 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:29:14 user nova-compute[75235]: FIRMWARE:
Nov 29 19:29:14 user nova-compute[75235]: No targets found.
Nov 29 19:29:14 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:29:14 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:29:14 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8897c74c-b18c-4817-a52d-aac2825201ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65403d2-a742-4160-9ec2-923be4757f85]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:14 user nova-compute[75235]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 (non-flash)
Nov 29 19:29:14 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:14 user nova-compute[75235]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 (non-flash)
Nov 29 19:29:14 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c5c5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9e6df-ade3-4792-9bd7-7ddc597f9df0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5583dc13-1887-4777-983e-4fd09fd1f12b]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[105fee9a-2d33-4d6f-9ba3-fbdb6000693c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e390e19-f4b3-4a73-895b-953fbb31affe]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[507258a3-b9e1-4e80-94a5-693c5d501e9f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0caa3d-54c5-4335-9df1-79e7c97320ae]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260]
Nov 29 19:29:14 user nova-compute[75235]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8, portal: 172.16.0.220,3260] successful.
Nov 29 19:29:14 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b468a6eb-6e67-42b8-b511-13dd3c07f798]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== disconnect_volume: return (288ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:29:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG nova.objects.instance [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'flavor' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-f0cb20d4-4e16-42ad-bc7e-3864e30da77d tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.729s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.595s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:15 user nova-compute[75235]: INFO nova.compute.manager [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Terminating instance
Nov 29 19:29:15 user nova-compute[75235]: DEBUG nova.compute.manager [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf0b52e2-19c1-4cc9-8408-151f9c16f04d req-ceb4790c-e876-4243-9964-828f92d82477 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-vif-unplugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf0b52e2-19c1-4cc9-8408-151f9c16f04d req-ceb4790c-e876-4243-9964-828f92d82477 service nova] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf0b52e2-19c1-4cc9-8408-151f9c16f04d req-ceb4790c-e876-4243-9964-828f92d82477 service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cf0b52e2-19c1-4cc9-8408-151f9c16f04d req-ceb4790c-e876-4243-9964-828f92d82477 service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf0b52e2-19c1-4cc9-8408-151f9c16f04d req-ceb4790c-e876-4243-9964-828f92d82477 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] No waiting events found dispatching network-vif-unplugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.compute.manager [req-cf0b52e2-19c1-4cc9-8408-151f9c16f04d req-ceb4790c-e876-4243-9964-828f92d82477 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-vif-unplugged-1068923c-1a5a-4d34-9727-2f38755c7a26 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:29:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Instance destroyed successfully.
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lazy-loading 'resources' on Instance uuid 35a58a85-65f9-45b8-a8a3-f69ecfad5295 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:26:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-828681369',display_name='tempest-VolumesSnapshotTestJSON-instance-828681369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-828681369',id=44,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSXjOk3QuLTs/zlg0MrKxAX3hRXhVM5JGcwrG3SYK5//APBCLfIj0qz5cN19RC1hGPyNaF2jUdDRyBknIaDgMNlCgERK3h/cgytg8htBkwTw8S75uljcM/+CKZ9AQektw==',key_name='tempest-keypair-309916703',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:26:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ad88693560a465299e61e263c402de3',ramdisk_id='',reservation_id='r-y5fatmke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1975532199',owner_user_name='tempest-VolumesSnapshotTestJSON-1975532199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aec9d4541474364baae470f90efe2ea',uuid=35a58a85-65f9-45b8-a8a3-f69ecfad5295,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converting VIF {"id": "1068923c-1a5a-4d34-9727-2f38755c7a26", "address": "fa:16:3e:47:97:b1", "network": {"id": "da167209-c012-4c63-a3fd-2897badd3cd3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-234595435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ad88693560a465299e61e263c402de3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1068923c-1a", "ovs_interfaceid": "1068923c-1a5a-4d34-9727-2f38755c7a26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_vif [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1068923c-1a, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70f3aeb8-6b4c-42fd-9181-f219482e467a) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:16 user nova-compute[75235]: INFO os_vif [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:97:b1,bridge_name='br-int',has_traffic_filtering=True,id=1068923c-1a5a-4d34-9727-2f38755c7a26,network=Network(da167209-c012-4c63-a3fd-2897badd3cd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1068923c-1a')
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxljQrSU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:29:16 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3155e0db-501c-4cca-8c64-2d6926b848b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:29:16 user nova-compute[75235]: No targets found.
Nov 29 19:29:16 user nova-compute[75235]: iSNS:
Nov 29 19:29:16 user nova-compute[75235]: No targets found.
Nov 29 19:29:16 user nova-compute[75235]: STATIC:
Nov 29 19:29:16 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:29:16 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:29:16 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:29:16 user nova-compute[75235]: FIRMWARE:
Nov 29 19:29:16 user nova-compute[75235]: No targets found.
Nov 29 19:29:16 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:29:16 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:29:16 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d8ff5d-ebf1-4059-a529-5449720d8df8', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f0a0b-453f-4cab-8aef-74c23b8c4a7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[abce0148-793f-4f6c-b732-f8aede14430d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:16 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:16 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56503fd900>, {}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Disconnecting from: [] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] <== disconnect_volume: return (76ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:29:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Deleting instance files /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295_del
Nov 29 19:29:16 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Deletion of /opt/stack/data/nova/instances/35a58a85-65f9-45b8-a8a3-f69ecfad5295_del complete
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:29:16 user nova-compute[75235]: INFO nova.compute.manager [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 19:29:16 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:29:16 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating instance_info_cache with network_info: [{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:17 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Took 0.70 seconds to deallocate network for instance.
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.compute.manager [req-3fcf3e51-606d-4bb0-8648-1b9717e7babd req-7f87e953-fc77-46f8-8a4a-41a21f1ae9e2 service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-vif-deleted-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:17 user nova-compute[75235]: WARNING nova.volume.cinder [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Attachment 7f4aecba-ad4d-450b-889e-1a4e4d842bc5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7f4aecba-ad4d-450b-889e-1a4e4d842bc5. (HTTP 404) (Request-ID: req-1896312a-67d1-4e27-b0eb-ee5cfcce2dd7)
Nov 29 19:29:17 user nova-compute[75235]: INFO nova.compute.manager [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Took 0.02 seconds to detach 1 volumes for instance.
Nov 29 19:29:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:29:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:17 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Deleted allocations for instance 35a58a85-65f9-45b8-a8a3-f69ecfad5295
Nov 29 19:29:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0b76c8e3-77f1-4e77-8dec-cd9de18cdbc9 tempest-VolumesSnapshotTestJSON-1975532199 tempest-VolumesSnapshotTestJSON-1975532199-project-member] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-18a62e43-34b9-4ab1-8044-fe690f2df7dd req-ea5ca607-4050-4e02-8e68-12a97138264d service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received event network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-18a62e43-34b9-4ab1-8044-fe690f2df7dd req-ea5ca607-4050-4e02-8e68-12a97138264d service nova] Acquiring lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-18a62e43-34b9-4ab1-8044-fe690f2df7dd req-ea5ca607-4050-4e02-8e68-12a97138264d service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-18a62e43-34b9-4ab1-8044-fe690f2df7dd req-ea5ca607-4050-4e02-8e68-12a97138264d service nova] Lock "35a58a85-65f9-45b8-a8a3-f69ecfad5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:18 user nova-compute[75235]: DEBUG nova.compute.manager [req-18a62e43-34b9-4ab1-8044-fe690f2df7dd req-ea5ca607-4050-4e02-8e68-12a97138264d service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] No waiting events found dispatching network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:29:18 user nova-compute[75235]: WARNING nova.compute.manager [req-18a62e43-34b9-4ab1-8044-fe690f2df7dd req-ea5ca607-4050-4e02-8e68-12a97138264d service nova] [instance: 35a58a85-65f9-45b8-a8a3-f69ecfad5295] Received unexpected event network-vif-plugged-1068923c-1a5a-4d34-9727-2f38755c7a26 for instance with vm_state deleted and task_state None.
Nov 29 19:29:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-changed-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG nova.compute.manager [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Refreshing instance network info cache due to event network-changed-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] Acquiring lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] Acquired lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Refreshing network info cache for port 2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updated VIF entry in instance network info cache for port 2dc53f98-6cde-4e3d-9f55-cf9234cb99a9. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG nova.network.neutron [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating instance_info_cache with network_info: [{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-4d9745af-d9b7-454e-8570-64f8481de1cc req-d8f33da2-22a9-4491-93de-459b9d8dfc7e service nova] Releasing lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:29:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG nova.objects.instance [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:27 user nova-compute[75235]: INFO nova.compute.manager [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Attaching volume 59fdef9f-2618-4d70-b11c-abb43e637758 to /dev/vdb
Nov 29 19:29:27 user nova-compute[75235]: DEBUG os_brick.utils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef197f80-cba7-4393-8d1b-bcf161b1d2dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[765e9de6-ebbb-4133-a533-57e3c074058d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10dc765-4d67-41ca-9fa8-bb77efb39bd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f95f7b1-62ad-4b97-b795-6e69a82be4ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:29:27 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:29:27 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba503347-030d-4c13-b347-98025b7781f6]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG os_brick.utils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:29:27 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating existing volume attachment record: ed413f3f-1dec-4884-bd57-106f0bb010f9 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:29:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKixDPmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:29:34 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:29:34 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:29:34 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0570d2-b5ce-4c4d-b529-441743353a65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:29:34 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7114ab-1619-440c-8604-ae73dd83ef23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758] added
Nov 29 19:29:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[728a73e5-5970-4ed3-a746-0859d1a18e19]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75090e-efd0-4ed3-aaff-d1ecbab9d849]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKixDPmR {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKixDPmR" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2dad1-ea99-438f-91ec-9654b5a5a36a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sKixDPmR'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8499152-7bd7-45d0-9b54-b1c76514b3be]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[261717b0-b754-48ee-ae4f-bcab64475883]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[955341ad-18ef-4cb9-8b4b-d2804a8470f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260]
Nov 29 19:29:34 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260] successful.
Nov 29 19:29:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a57ec2-0440-4cf3-883a-be8decbc452a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baaead3-8eee-4f86-8911-4b1820b04c04]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:34 user nova-compute[75235]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:29:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:34 user nova-compute[75235]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:29:34 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4719d-fc2b-4568-b8b9-7150b23380f7]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:29:34 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKixDPmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:29:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:29:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23138336562646335', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:29:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138336562646335', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:29:35 user nova-compute[75235]: DEBUG nova.objects.instance [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:29:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:29:35 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:29:35 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:29:35 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:29:35 user nova-compute[75235]:   <serial>59fdef9f-2618-4d70-b11c-abb43e637758</serial>
Nov 29 19:29:35 user nova-compute[75235]: </disk>
Nov 29 19:29:35 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:29:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:29:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:29:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:87:38:f9, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:29:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cd8e23f6-49a7-4854-b5be-6dd8f09aee4f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.188s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:29:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:29:39 user nova-compute[75235]: INFO nova.compute.claims [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Claim successful on node user
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:29:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:29:39 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.policy [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c44ac18976b4232a45bedacf9177023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2594a91424a6408a9c6c57d5364bc9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:29:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Creating image(s)
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.222s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk 1073741824" returned: 0 in 0.046s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Successfully created port: 9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Cannot resize image /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Ensure instance console log exists: /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Successfully updated port: 9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquired lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-changed-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Refreshing instance network info cache due to event network-changed-9f8e4a02-3fc5-442a-b116-22921e4d6495. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] Acquiring lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Updating instance_info_cache with network_info: [{"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Releasing lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Instance network_info: |[{"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] Acquired lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.network.neutron [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Refreshing network info cache for port 9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Start _get_guest_xml network_info=[{"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:29:41 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:29:41 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:29:41 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-183134823',display_name='tempest-AttachVolumeNegativeTest-server-183134823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-183134823',id=48,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIOrecA0GaDOO+GYr1T1wjiNk37iPgbxeInfMWGvLamE9HSL27tKcdfnqPPbu06Z/HQUedZFr/GwvIAqxZx45bi88JbyMAE3xVtJ3IR+eWjjw2Rw/oqKtkLI2QSlT+W0Q==',key_name='tempest-keypair-1898779602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-27kyz0a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.objects.instance [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:29:42 user nova-compute[75235]:   <uuid>2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7</uuid>
Nov 29 19:29:42 user nova-compute[75235]:   <name>instance-00000030</name>
Nov 29 19:29:42 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:29:42 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:29:42 user nova-compute[75235]:   <metadata>
Nov 29 19:29:42 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:29:42 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:29:42 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeNegativeTest-server-183134823</nova:name>
Nov 29 19:29:42 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:29:41</nova:creationTime>
Nov 29 19:29:42 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:29:42 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:29:42 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:29:42 user nova-compute[75235]:       <nova:owner>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:user uuid="4c44ac18976b4232a45bedacf9177023">tempest-AttachVolumeNegativeTest-1078373175-project-member</nova:user>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:project uuid="2594a91424a6408a9c6c57d5364bc9bb">tempest-AttachVolumeNegativeTest-1078373175</nova:project>
Nov 29 19:29:42 user nova-compute[75235]:       </nova:owner>
Nov 29 19:29:42 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:29:42 user nova-compute[75235]:       <nova:ports>
Nov 29 19:29:42 user nova-compute[75235]:         <nova:port uuid="9f8e4a02-3fc5-442a-b116-22921e4d6495">
Nov 29 19:29:42 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:29:42 user nova-compute[75235]:         </nova:port>
Nov 29 19:29:42 user nova-compute[75235]:       </nova:ports>
Nov 29 19:29:42 user nova-compute[75235]:     </nova:instance>
Nov 29 19:29:42 user nova-compute[75235]:   </metadata>
Nov 29 19:29:42 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:29:42 user nova-compute[75235]:     <system>
Nov 29 19:29:42 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:29:42 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:29:42 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:29:42 user nova-compute[75235]:       <entry name="serial">2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7</entry>
Nov 29 19:29:42 user nova-compute[75235]:       <entry name="uuid">2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7</entry>
Nov 29 19:29:42 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:29:42 user nova-compute[75235]:     </system>
Nov 29 19:29:42 user nova-compute[75235]:   </sysinfo>
Nov 29 19:29:42 user nova-compute[75235]:   <os>
Nov 29 19:29:42 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:29:42 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:29:42 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:29:42 user nova-compute[75235]:   </os>
Nov 29 19:29:42 user nova-compute[75235]:   <features>
Nov 29 19:29:42 user nova-compute[75235]:     <acpi/>
Nov 29 19:29:42 user nova-compute[75235]:     <apic/>
Nov 29 19:29:42 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:29:42 user nova-compute[75235]:   </features>
Nov 29 19:29:42 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:29:42 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:29:42 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:29:42 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:29:42 user nova-compute[75235]:   </clock>
Nov 29 19:29:42 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:29:42 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:29:42 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:29:42 user nova-compute[75235]:   </cpu>
Nov 29 19:29:42 user nova-compute[75235]:   <devices>
Nov 29 19:29:42 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:29:42 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:29:42 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk"/>
Nov 29 19:29:42 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:29:42 user nova-compute[75235]:     </disk>
Nov 29 19:29:42 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:29:42 user nova-compute[75235]:       <mac address="fa:16:3e:74:55:cf"/>
Nov 29 19:29:42 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:29:42 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:29:42 user nova-compute[75235]:       <target dev="tap9f8e4a02-3f"/>
Nov 29 19:29:42 user nova-compute[75235]:     </interface>
Nov 29 19:29:42 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:29:42 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/console.log" append="off"/>
Nov 29 19:29:42 user nova-compute[75235]:     </serial>
Nov 29 19:29:42 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:29:42 user nova-compute[75235]:     <video>
Nov 29 19:29:42 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:29:42 user nova-compute[75235]:     </video>
Nov 29 19:29:42 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:29:42 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:29:42 user nova-compute[75235]:     </rng>
Nov 29 19:29:42 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:29:42 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:29:42 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:29:42 user nova-compute[75235]:     </memballoon>
Nov 29 19:29:42 user nova-compute[75235]:   </devices>
Nov 29 19:29:42 user nova-compute[75235]: </domain>
Nov 29 19:29:42 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-183134823',display_name='tempest-AttachVolumeNegativeTest-server-183134823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-183134823',id=48,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIOrecA0GaDOO+GYr1T1wjiNk37iPgbxeInfMWGvLamE9HSL27tKcdfnqPPbu06Z/HQUedZFr/GwvIAqxZx45bi88JbyMAE3xVtJ3IR+eWjjw2Rw/oqKtkLI2QSlT+W0Q==',key_name='tempest-keypair-1898779602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-27kyz0a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG os_vif [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '989613d8-0248-5398-9c22-a795d86846a5', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f8e4a02-3f, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f8e4a02-3f, col_values=(('qos', UUID('ad5ed02b-d41d-4bc3-ab77-23fdc8e556ef')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f8e4a02-3f, col_values=(('external_ids', {'iface-id': '9f8e4a02-3fc5-442a-b116-22921e4d6495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:55:cf', 'vm-uuid': '2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:42 user nova-compute[75235]: INFO os_vif [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f')
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:74:55:cf, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.network.neutron [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Updated VIF entry in instance network info cache for port 9f8e4a02-3fc5-442a-b116-22921e4d6495. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG nova.network.neutron [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Updating instance_info_cache with network_info: [{"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:42 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-df2d01f2-3829-4522-9882-e017429f4681 req-22eb89dd-dddf-4bb1-89ec-b2f0a560e102 service nova] Releasing lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-1ce545ca-c0eb-4d00-b644-0ed12230f502 req-148af52d-d10e-4842-a073-4cff6c8ab68b service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1ce545ca-c0eb-4d00-b644-0ed12230f502 req-148af52d-d10e-4842-a073-4cff6c8ab68b service nova] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1ce545ca-c0eb-4d00-b644-0ed12230f502 req-148af52d-d10e-4842-a073-4cff6c8ab68b service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1ce545ca-c0eb-4d00-b644-0ed12230f502 req-148af52d-d10e-4842-a073-4cff6c8ab68b service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:43 user nova-compute[75235]: DEBUG nova.compute.manager [req-1ce545ca-c0eb-4d00-b644-0ed12230f502 req-148af52d-d10e-4842-a073-4cff6c8ab68b service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] No waiting events found dispatching network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:29:43 user nova-compute[75235]: WARNING nova.compute.manager [req-1ce545ca-c0eb-4d00-b644-0ed12230f502 req-148af52d-d10e-4842-a073-4cff6c8ab68b service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received unexpected event network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 for instance with vm_state building and task_state spawning.
Nov 29 19:29:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:29:45 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Instance spawned successfully.
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:29:45 user nova-compute[75235]: INFO nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:29:45 user nova-compute[75235]: INFO nova.compute.manager [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Took 6.05 seconds to build instance.
Nov 29 19:29:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cabf9d4c-7039-4826-85d2-f54916bd7967 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.152s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-a797cca6-9524-415d-8566-570cf460ea92 req-d98c0d6e-19e9-4f57-a4c3-58ecad4f8850 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a797cca6-9524-415d-8566-570cf460ea92 req-d98c0d6e-19e9-4f57-a4c3-58ecad4f8850 service nova] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a797cca6-9524-415d-8566-570cf460ea92 req-d98c0d6e-19e9-4f57-a4c3-58ecad4f8850 service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a797cca6-9524-415d-8566-570cf460ea92 req-d98c0d6e-19e9-4f57-a4c3-58ecad4f8850 service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-a797cca6-9524-415d-8566-570cf460ea92 req-d98c0d6e-19e9-4f57-a4c3-58ecad4f8850 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] No waiting events found dispatching network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:29:45 user nova-compute[75235]: WARNING nova.compute.manager [req-a797cca6-9524-415d-8566-570cf460ea92 req-d98c0d6e-19e9-4f57-a4c3-58ecad4f8850 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received unexpected event network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 for instance with vm_state active and task_state None.
Nov 29 19:29:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-changed-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Refreshing instance network info cache due to event network-changed-532ab5e9-6ea8-4740-9a8b-6af34beff956. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:29:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] Acquiring lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:29:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] Acquired lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:29:51 user nova-compute[75235]: DEBUG nova.network.neutron [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Refreshing network info cache for port 532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updated VIF entry in instance network info cache for port 532ab5e9-6ea8-4740-9a8b-6af34beff956. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.network.neutron [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updating instance_info_cache with network_info: [{"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a5ba2d1b-1d2c-4ecf-8c1f-3f13da2ce665 req-e780f6c6-4c4a-493a-ac26-1aa3f466be27 service nova] Releasing lock "refresh_cache-28bafdff-f4f0-4dae-915b-8831ffdcd6b9" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:52 user nova-compute[75235]: INFO nova.compute.manager [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Terminating instance
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ffaaa0-1138-4416-bafe-92476f6ae995 req-95551a95-ed0a-4891-979b-b6a055eab04b service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-vif-unplugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ffaaa0-1138-4416-bafe-92476f6ae995 req-95551a95-ed0a-4891-979b-b6a055eab04b service nova] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ffaaa0-1138-4416-bafe-92476f6ae995 req-95551a95-ed0a-4891-979b-b6a055eab04b service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-76ffaaa0-1138-4416-bafe-92476f6ae995 req-95551a95-ed0a-4891-979b-b6a055eab04b service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ffaaa0-1138-4416-bafe-92476f6ae995 req-95551a95-ed0a-4891-979b-b6a055eab04b service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] No waiting events found dispatching network-vif-unplugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.compute.manager [req-76ffaaa0-1138-4416-bafe-92476f6ae995 req-95551a95-ed0a-4891-979b-b6a055eab04b service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-vif-unplugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:29:52 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Instance destroyed successfully.
Nov 29 19:29:52 user nova-compute[75235]: DEBUG nova.objects.instance [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'resources' on Instance uuid 28bafdff-f4f0-4dae-915b-8831ffdcd6b9 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487695319',display_name='tempest-TestVolumeBootPattern-server-487695319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487695319',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:28:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-0gygeno8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:28:14Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=28bafdff-f4f0-4dae-915b-8831ffdcd6b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "address": "fa:16:3e:93:76:fc", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532ab5e9-6e", "ovs_interfaceid": "532ab5e9-6ea8-4740-9a8b-6af34beff956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_vif [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532ab5e9-6e, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8130fa60-c5ea-4e5e-ae97-8fcdae430beb) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:29:53 user nova-compute[75235]: INFO os_vif [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:76:fc,bridge_name='br-int',has_traffic_filtering=True,id=532ab5e9-6ea8-4740-9a8b-6af34beff956,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532ab5e9-6e')
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:29:53 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c29c3c-c24d-40bb-a0e7-d552fe1056a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:29:53 user nova-compute[75235]: No targets found.
Nov 29 19:29:53 user nova-compute[75235]: iSNS:
Nov 29 19:29:53 user nova-compute[75235]: No targets found.
Nov 29 19:29:53 user nova-compute[75235]: STATIC:
Nov 29 19:29:53 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758
Nov 29 19:29:53 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:29:53 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:29:53 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:29:53 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:29:53 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:29:53 user nova-compute[75235]: FIRMWARE:
Nov 29 19:29:53 user nova-compute[75235]: No targets found.
Nov 29 19:29:53 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:29:53 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:29:53 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59a0680-ea68-44df-a298-264cf5d4ea2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be601e-05ce-4c24-9ce0-c0d911968f46]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:53 user nova-compute[75235]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:29:53 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:29:53 user nova-compute[75235]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:29:53 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56503fce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a9b3b3-1d7d-4390-95f8-4b2f288e0a77]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0aae43-637c-4b3f-8381-705613cdb789]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4381956-6332-43d2-9260-e4405202a7cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe433493-929e-4534-8512-da7b6c97f2e6]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_eff9b271', '/dev/disk/by-id/scsi-1SCST_BIOeff9b271-b0c30a10a8b7711d', '/dev/disk/by-id/scsi-26230633330613130') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f819600-a3c2-4a11-bb08-6edcbc305bb5]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8e3e8-e9f7-4acb-8777-678a5a47a589]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2cc34-d82b-4682-aa07-69064a34a7ef]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]
Nov 29 19:29:53 user nova-compute[75235]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.
Nov 29 19:29:53 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573f272-c686-489d-b369-05d5f22f5d7b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== disconnect_volume: return (313ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:29:53 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Deleting instance files /opt/stack/data/nova/instances/28bafdff-f4f0-4dae-915b-8831ffdcd6b9_del
Nov 29 19:29:53 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Deletion of /opt/stack/data/nova/instances/28bafdff-f4f0-4dae-915b-8831ffdcd6b9_del complete
Nov 29 19:29:53 user nova-compute[75235]: INFO nova.compute.manager [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 19:29:53 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:29:53 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:29:54 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:29:54 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Took 0.94 seconds to deallocate network for instance.
Nov 29 19:29:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] Acquiring lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] No waiting events found dispatching network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:29:54 user nova-compute[75235]: WARNING nova.compute.manager [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received unexpected event network-vif-plugged-532ab5e9-6ea8-4740-9a8b-6af34beff956 for instance with vm_state active and task_state deleting.
Nov 29 19:29:54 user nova-compute[75235]: DEBUG nova.compute.manager [req-b02d2fa9-047e-45ad-bfb6-fa30e8d97fb7 req-483dd63f-9a20-47ec-9a45-f24fe3542f05 service nova] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Received event network-vif-deleted-532ab5e9-6ea8-4740-9a8b-6af34beff956 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:29:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:55 user nova-compute[75235]: INFO nova.compute.manager [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 28bafdff-f4f0-4dae-915b-8831ffdcd6b9] Took 0.81 seconds to detach 1 volumes for instance.
Nov 29 19:29:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:29:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:29:55 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:29:55 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:29:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:55 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Deleted allocations for instance 28bafdff-f4f0-4dae-915b-8831ffdcd6b9
Nov 29 19:29:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-b5b2453b-9436-48e9-8616-e46021d28daf tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "28bafdff-f4f0-4dae-915b-8831ffdcd6b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.301s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:29:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:29:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:12 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:30:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:30:14 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.07244110107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f5f6210e-b04f-4920-9285-5177f5c2cada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:30:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:30:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:30:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-changed-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG nova.compute.manager [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Refreshing instance network info cache due to event network-changed-03dc0728-2b84-4329-86a3-5ba3313242ac. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] Acquiring lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] Acquired lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Refreshing network info cache for port 03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updated VIF entry in instance network info cache for port 03dc0728-2b84-4329-86a3-5ba3313242ac. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:30:26 user nova-compute[75235]: DEBUG nova.network.neutron [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:30:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b6af2131-6ae5-4d91-8286-6f1cacfb106a req-758c6136-992c-4c82-9e97-d500f7cf9870 service nova] Releasing lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:30:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:30:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:29 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG nova.objects.instance [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.169s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:30 user nova-compute[75235]: INFO nova.compute.manager [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attaching volume 9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 to /dev/vdb
Nov 29 19:30:30 user nova-compute[75235]: DEBUG os_brick.utils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[66063d3d-754a-4dd9-8a1e-a53c4a493e39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3077b56-8c53-48cc-a41f-cb0f0a517fcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac444e95-6a19-4b45-ad08-2c88ccbce485]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2d831-6cec-4ad7-b5f8-f438e2579515]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:30:30 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:30:30 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[290924b4-43cf-4a44-8014-313fa0a529cf]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG os_brick.utils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:30:30 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating existing volume attachment record: 46fc19c3-5c0f-408c-9565-49bc1b9dddf9 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:30:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKYGcaEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:30:38 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:30:38 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:30:38 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f2f6fe-36aa-47cb-80a1-c98754bc46c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:30:38 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86c65ec-d9f6-4e05-a86a-a009db4e22a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65] added
Nov 29 19:30:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d560bce6-21e5-4d5c-9a7c-4cf8358b1224]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cc65a2-f575-4273-b00a-1abc4e539134]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vKYGcaEX {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vKYGcaEX" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3259a-2524-414b-a6f1-0c3e8a06054c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vKYGcaEX'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e538467-a622-4c0d-a23e-e31ae67520c6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44fc47-3b6a-464f-bbf5-86121bd8fb0b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --login" returned: 0 in 0.128s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[618d0f18-cd28-443a-8f4f-d10acf54debd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260]
Nov 29 19:30:38 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260] successful.
Nov 29 19:30:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83d7e7-e98e-48da-b468-9f1b5940a6cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad0ab0-d4a1-4f01-8779-0ea5b40a1c64]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:38 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:30:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:38 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:30:38 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c087aee-55d2-4e36-809a-c25f876f17c3]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:30:38 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKYGcaEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:30:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:30:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23234383936666231', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:30:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234383936666231', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:30:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:30:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:30:39 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:30:39 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:30:39 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:30:39 user nova-compute[75235]:   <serial>9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65</serial>
Nov 29 19:30:39 user nova-compute[75235]: </disk>
Nov 29 19:30:39 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:30:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:30:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:30:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No VIF found with MAC fa:16:3e:58:22:e3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:30:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-47304671-0c99-47a2-9181-5d738ffd8146 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.915s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:30:44 user nova-compute[75235]: INFO nova.compute.claims [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Claim successful on node user
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:30:44 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.policy [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20d52323a014526b5ebd121d637f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e15c428b2f43b9a2e5850370c4f938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:30:44 user nova-compute[75235]: INFO nova.virt.block_device [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Booting with volume 7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b at /dev/vda
Nov 29 19:30:44 user nova-compute[75235]: DEBUG os_brick.utils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2da5db-8821-4988-889a-6688d0f6967b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cc9f2-f19d-4ee4-9696-12f4fadbf8e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c232b403-53ae-4ba8-bc4a-11a00e1e8445]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f0284-a280-47c3-b583-ca838ea08d6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:30:44 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:30:44 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3984a5e0-97aa-4f4d-9ba4-d203a9e6b853]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG os_brick.utils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating existing volume attachment record: 8adf7c72-4d78-4095-8f10-6a4139d93a88 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:30:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Successfully created port: afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Successfully updated port: afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquired lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-changed-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Refreshing instance network info cache due to event network-changed-afab173b-1dda-4e85-8a9c-127b0ab40a57. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] Acquiring lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:30:45 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Releasing lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Instance network_info: |[{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] Acquired lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Refreshing network info cache for port afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updated VIF entry in instance network info cache for port afab173b-1dda-4e85-8a9c-127b0ab40a57. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:30:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7f08eb0c-0a08-4ae3-9b7b-64e16d795d5b req-6e337eb7-43ad-49ae-b8b4-6bd079bf3b14 service nova] Releasing lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:30:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:30:52 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Creating image(s)
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Ensure instance console log exists: /opt/stack/data/nova/instances/663ab537-b6c8-4465-a0b7-8c83de1bbe34/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Start _get_guest_xml network_info=[{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8adf7c72-4d78-4095-8f10-6a4139d93a88', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '663ab537-b6c8-4465-a0b7-8c83de1bbe34', 'attached_at': '', 'detached_at': '', 'volume_id': '7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'serial': '7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:30:52 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:30:52 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:30:52 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:30:52 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:30:52 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32f79d9-a27d-482e-886f-dd5ef2c08d52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:30:52 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed93720-3550-44ed-8b9c-c524b9a1e73d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b] added
Nov 29 19:30:52 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e271c4c8-b7cd-4e29-a6c6-84bbecff2297]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdeb755-c5fa-4cc9-9394-2d4af351bf08]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRGulkqw {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRGulkqw" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ea670-7aa4-4026-97f9-855c82adafc9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRGulkqw'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[04813d87-6b67-451e-ad77-a9d4d99bda45]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cdc93e-8999-42ec-9256-8085fdd5bd06]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e396a173-5229-454a-a261-26c060ea0394]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]
Nov 29 19:30:52 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.
Nov 29 19:30:52 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a297ba-5444-44e1-abdf-7d6b03da67a9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b9113-3ec5-4619-8012-45d6fe2a7626]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:30:52 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:30:52 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:30:52 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:30:52 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:30:53 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:30:53 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e7023-fb60-4255-9c13-563dcfc231d2]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:30:53 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:30:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26230633330613130', 'path': '/dev/sdd'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230633330613130', 'path': '/dev/sdd'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1537076786',display_name='tempest-TestVolumeBootPattern-server-1537076786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1537076786',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-rwhm0wdn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:30:45Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=663ab537-b6c8-4465-a0b7-8c83de1bbe34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.objects.instance [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'pci_devices' on Instance uuid 663ab537-b6c8-4465-a0b7-8c83de1bbe34 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:30:54 user nova-compute[75235]:   <uuid>663ab537-b6c8-4465-a0b7-8c83de1bbe34</uuid>
Nov 29 19:30:54 user nova-compute[75235]:   <name>instance-00000031</name>
Nov 29 19:30:54 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:30:54 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:30:54 user nova-compute[75235]:   <metadata>
Nov 29 19:30:54 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:30:54 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:30:54 user nova-compute[75235]:       <nova:name>tempest-TestVolumeBootPattern-server-1537076786</nova:name>
Nov 29 19:30:54 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:30:52</nova:creationTime>
Nov 29 19:30:54 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:30:54 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:30:54 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:30:54 user nova-compute[75235]:       <nova:owner>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:user uuid="f20d52323a014526b5ebd121d637f4c4">tempest-TestVolumeBootPattern-656128499-project-member</nova:user>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:project uuid="87e15c428b2f43b9a2e5850370c4f938">tempest-TestVolumeBootPattern-656128499</nova:project>
Nov 29 19:30:54 user nova-compute[75235]:       </nova:owner>
Nov 29 19:30:54 user nova-compute[75235]:       <nova:ports>
Nov 29 19:30:54 user nova-compute[75235]:         <nova:port uuid="afab173b-1dda-4e85-8a9c-127b0ab40a57">
Nov 29 19:30:54 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 19:30:54 user nova-compute[75235]:         </nova:port>
Nov 29 19:30:54 user nova-compute[75235]:       </nova:ports>
Nov 29 19:30:54 user nova-compute[75235]:     </nova:instance>
Nov 29 19:30:54 user nova-compute[75235]:   </metadata>
Nov 29 19:30:54 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:30:54 user nova-compute[75235]:     <system>
Nov 29 19:30:54 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:30:54 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:30:54 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:30:54 user nova-compute[75235]:       <entry name="serial">663ab537-b6c8-4465-a0b7-8c83de1bbe34</entry>
Nov 29 19:30:54 user nova-compute[75235]:       <entry name="uuid">663ab537-b6c8-4465-a0b7-8c83de1bbe34</entry>
Nov 29 19:30:54 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:30:54 user nova-compute[75235]:     </system>
Nov 29 19:30:54 user nova-compute[75235]:   </sysinfo>
Nov 29 19:30:54 user nova-compute[75235]:   <os>
Nov 29 19:30:54 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:30:54 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:30:54 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:30:54 user nova-compute[75235]:   </os>
Nov 29 19:30:54 user nova-compute[75235]:   <features>
Nov 29 19:30:54 user nova-compute[75235]:     <acpi/>
Nov 29 19:30:54 user nova-compute[75235]:     <apic/>
Nov 29 19:30:54 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:30:54 user nova-compute[75235]:   </features>
Nov 29 19:30:54 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:30:54 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:30:54 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:30:54 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:30:54 user nova-compute[75235]:   </clock>
Nov 29 19:30:54 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:30:54 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:30:54 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:30:54 user nova-compute[75235]:   </cpu>
Nov 29 19:30:54 user nova-compute[75235]:   <devices>
Nov 29 19:30:54 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:30:54 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:30:54 user nova-compute[75235]:       <source dev="/dev/sdd"/>
Nov 29 19:30:54 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:30:54 user nova-compute[75235]:       <serial>7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b</serial>
Nov 29 19:30:54 user nova-compute[75235]:     </disk>
Nov 29 19:30:54 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:30:54 user nova-compute[75235]:       <mac address="fa:16:3e:7d:34:76"/>
Nov 29 19:30:54 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:30:54 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:30:54 user nova-compute[75235]:       <target dev="tapafab173b-1d"/>
Nov 29 19:30:54 user nova-compute[75235]:     </interface>
Nov 29 19:30:54 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:30:54 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/663ab537-b6c8-4465-a0b7-8c83de1bbe34/console.log" append="off"/>
Nov 29 19:30:54 user nova-compute[75235]:     </serial>
Nov 29 19:30:54 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:30:54 user nova-compute[75235]:     <video>
Nov 29 19:30:54 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:30:54 user nova-compute[75235]:     </video>
Nov 29 19:30:54 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:30:54 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:30:54 user nova-compute[75235]:     </rng>
Nov 29 19:30:54 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:30:54 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:30:54 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:30:54 user nova-compute[75235]:     </memballoon>
Nov 29 19:30:54 user nova-compute[75235]:   </devices>
Nov 29 19:30:54 user nova-compute[75235]: </domain>
Nov 29 19:30:54 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1537076786',display_name='tempest-TestVolumeBootPattern-server-1537076786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1537076786',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-rwhm0wdn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:30:45Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=663ab537-b6c8-4465-a0b7-8c83de1bbe34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG os_vif [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1a2d741-9103-5579-965d-5ef32763ec04', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafab173b-1d, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafab173b-1d, col_values=(('qos', UUID('c7504511-2181-4837-b456-c8c98d2035a2')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafab173b-1d, col_values=(('external_ids', {'iface-id': 'afab173b-1dda-4e85-8a9c-127b0ab40a57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:34:76', 'vm-uuid': '663ab537-b6c8-4465-a0b7-8c83de1bbe34'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:54 user nova-compute[75235]: INFO os_vif [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d')
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No VIF found with MAC fa:16:3e:7d:34:76, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:30:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1cacf2c8-4259-41ad-a89a-919b00063fd1 req-d4069ab6-1187-4ebb-8843-82b75028fcff service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1cacf2c8-4259-41ad-a89a-919b00063fd1 req-d4069ab6-1187-4ebb-8843-82b75028fcff service nova] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1cacf2c8-4259-41ad-a89a-919b00063fd1 req-d4069ab6-1187-4ebb-8843-82b75028fcff service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1cacf2c8-4259-41ad-a89a-919b00063fd1 req-d4069ab6-1187-4ebb-8843-82b75028fcff service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:55 user nova-compute[75235]: DEBUG nova.compute.manager [req-1cacf2c8-4259-41ad-a89a-919b00063fd1 req-d4069ab6-1187-4ebb-8843-82b75028fcff service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] No waiting events found dispatching network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:30:55 user nova-compute[75235]: WARNING nova.compute.manager [req-1cacf2c8-4259-41ad-a89a-919b00063fd1 req-d4069ab6-1187-4ebb-8843-82b75028fcff service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received unexpected event network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 for instance with vm_state building and task_state spawning.
Nov 29 19:30:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:57 user nova-compute[75235]: INFO nova.compute.manager [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Detaching volume 9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65
Nov 29 19:30:57 user nova-compute[75235]: INFO nova.virt.block_device [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attempting to driver detach volume 9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 from mountpoint /dev/vdb
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Attempting to detach device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:30:57 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:30:57 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:30:57 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:30:57 user nova-compute[75235]:   <serial>9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65</serial>
Nov 29 19:30:57 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:30:57 user nova-compute[75235]: </disk>
Nov 29 19:30:57 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:30:57 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config.
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:30:57 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:30:57 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:30:57 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:30:57 user nova-compute[75235]:   <serial>9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65</serial>
Nov 29 19:30:57 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:30:57 user nova-compute[75235]: </disk>
Nov 29 19:30:57 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:30:57 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Instance spawned successfully.
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c131266-cb4a-4b94-a9b7-65be5d229bc6 req-79afb586-4ed3-421b-ae5f-73f821a268f6 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c131266-cb4a-4b94-a9b7-65be5d229bc6 req-79afb586-4ed3-421b-ae5f-73f821a268f6 service nova] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c131266-cb4a-4b94-a9b7-65be5d229bc6 req-79afb586-4ed3-421b-ae5f-73f821a268f6 service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1c131266-cb4a-4b94-a9b7-65be5d229bc6 req-79afb586-4ed3-421b-ae5f-73f821a268f6 service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-1c131266-cb4a-4b94-a9b7-65be5d229bc6 req-79afb586-4ed3-421b-ae5f-73f821a268f6 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] No waiting events found dispatching network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:30:57 user nova-compute[75235]: WARNING nova.compute.manager [req-1c131266-cb4a-4b94-a9b7-65be5d229bc6 req-79afb586-4ed3-421b-ae5f-73f821a268f6 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received unexpected event network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 for instance with vm_state building and task_state spawning.
Nov 29 19:30:58 user nova-compute[75235]: INFO nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 29 19:30:58 user nova-compute[75235]: DEBUG nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:30:58 user nova-compute[75235]: INFO nova.compute.manager [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Took 14.06 seconds to build instance.
Nov 29 19:30:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-a5efa698-0284-49b2-af1c-275287f9c1a1 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.158s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:30:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:30:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:30:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:31:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:31:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8470MB free_disk=25.068248748779297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f5f6210e-b04f-4920-9285-5177f5c2cada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 663ab537-b6c8-4465-a0b7-8c83de1bbe34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:31:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:18 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 is timed out.
Nov 29 19:31:18 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config.
Nov 29 19:31:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vKYGcaEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:31:18 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39cb4a5-ea3c-495d-b92b-3ef9bf165e67]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:31:18 user nova-compute[75235]: No targets found.
Nov 29 19:31:18 user nova-compute[75235]: iSNS:
Nov 29 19:31:18 user nova-compute[75235]: No targets found.
Nov 29 19:31:18 user nova-compute[75235]: STATIC:
Nov 29 19:31:18 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758
Nov 29 19:31:18 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:31:18 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:31:18 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65
Nov 29 19:31:18 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:31:18 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:31:18 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:31:18 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:31:18 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:31:18 user nova-compute[75235]: FIRMWARE:
Nov 29 19:31:18 user nova-compute[75235]: No targets found.
Nov 29 19:31:18 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:31:18 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:31:18 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b4559b-8d74-428c-9259-969163b93573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4366d10c-3248-4d77-ac71-2bdc219e37b7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:31:18 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:31:18 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:31:18 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:31:18 user nova-compute[75235]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 (non-flash)
Nov 29 19:31:18 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:31:18 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c5f2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c7b14d-608f-45f5-a7c8-541181d21b13]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97b838-b9b3-42bb-ae02-8c9622174608]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa702716-63cd-4f8d-a23e-47fdc10b4bd9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ea7b4-a94f-48e4-be5f-ec23092c8533]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f90906-53e5-4870-8ec4-fba4d630727b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[36527360-81d3-45ec-bf9c-100fdc8021bc]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260]
Nov 29 19:31:18 user nova-compute[75235]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65, portal: 172.16.0.220,3260] successful.
Nov 29 19:31:18 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6e6c1f-e6b7-4cbf-8d0e-99862e92ba65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9001cb70-efdc-4985-a0a1-80ef22cd8f9c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== disconnect_volume: return (301ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:31:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG nova.objects.instance [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-aa6a5f53-edff-4729-a3d9-5277fae6577c tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.966s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:20 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating instance_info_cache with network_info: [{"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:31:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-f5f6210e-b04f-4920-9285-5177f5c2cada" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:31:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:31:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:26 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-changed-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG nova.compute.manager [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Refreshing instance network info cache due to event network-changed-9f8e4a02-3fc5-442a-b116-22921e4d6495. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] Acquiring lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] Acquired lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG nova.network.neutron [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Refreshing network info cache for port 9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:30 user nova-compute[75235]: INFO nova.compute.manager [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Terminating instance
Nov 29 19:31:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.network.neutron [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Updated VIF entry in instance network info cache for port 9f8e4a02-3fc5-442a-b116-22921e4d6495. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.network.neutron [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Updating instance_info_cache with network_info: [{"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6f4ca392-152e-4fc7-a812-d20c05cef1b0 req-1ef59634-ede4-4781-a406-eaf3b0a84b22 service nova] Releasing lock "refresh_cache-2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-bc785707-c54f-4db2-b3ef-31fae9354bb5 req-3c7c3839-ff1e-42ae-a3d1-b0368d819f5e service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-vif-unplugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-bc785707-c54f-4db2-b3ef-31fae9354bb5 req-3c7c3839-ff1e-42ae-a3d1-b0368d819f5e service nova] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-bc785707-c54f-4db2-b3ef-31fae9354bb5 req-3c7c3839-ff1e-42ae-a3d1-b0368d819f5e service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-bc785707-c54f-4db2-b3ef-31fae9354bb5 req-3c7c3839-ff1e-42ae-a3d1-b0368d819f5e service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-bc785707-c54f-4db2-b3ef-31fae9354bb5 req-3c7c3839-ff1e-42ae-a3d1-b0368d819f5e service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] No waiting events found dispatching network-vif-unplugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.compute.manager [req-bc785707-c54f-4db2-b3ef-31fae9354bb5 req-3c7c3839-ff1e-42ae-a3d1-b0368d819f5e service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-vif-unplugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Instance destroyed successfully.
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'resources' on Instance uuid 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-183134823',display_name='tempest-AttachVolumeNegativeTest-server-183134823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-183134823',id=48,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIOrecA0GaDOO+GYr1T1wjiNk37iPgbxeInfMWGvLamE9HSL27tKcdfnqPPbu06Z/HQUedZFr/GwvIAqxZx45bi88JbyMAE3xVtJ3IR+eWjjw2Rw/oqKtkLI2QSlT+W0Q==',key_name='tempest-keypair-1898779602',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:29:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-27kyz0a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:29:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "address": "fa:16:3e:74:55:cf", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8e4a02-3f", "ovs_interfaceid": "9f8e4a02-3fc5-442a-b116-22921e4d6495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG os_vif [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f8e4a02-3f, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad5ed02b-d41d-4bc3-ab77-23fdc8e556ef) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:31:31 user nova-compute[75235]: INFO os_vif [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:55:cf,bridge_name='br-int',has_traffic_filtering=True,id=9f8e4a02-3fc5-442a-b116-22921e4d6495,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8e4a02-3f')
Nov 29 19:31:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Deleting instance files /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7_del
Nov 29 19:31:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Deletion of /opt/stack/data/nova/instances/2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7_del complete
Nov 29 19:31:31 user nova-compute[75235]: INFO nova.compute.manager [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 19:31:31 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:31:31 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:31:32 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:31:32 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Took 0.76 seconds to deallocate network for instance.
Nov 29 19:31:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:32 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:31:32 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:31:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:32 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Deleted allocations for instance 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7
Nov 29 19:31:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-029120f4-77f5-4ba5-9632-a65f03dea3c4 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:31:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] Acquiring lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:33 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] Lock "2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] No waiting events found dispatching network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:31:33 user nova-compute[75235]: WARNING nova.compute.manager [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received unexpected event network-vif-plugged-9f8e4a02-3fc5-442a-b116-22921e4d6495 for instance with vm_state deleted and task_state None.
Nov 29 19:31:33 user nova-compute[75235]: DEBUG nova.compute.manager [req-a1dbfc94-7a93-4113-891d-b410e91bf0e0 req-e5bcd1c1-1bfb-41fe-b4d0-c4b08d50ca54 service nova] [instance: 2a2378b3-8ca7-48a8-b473-ab1f4ebffcd7] Received event network-vif-deleted-9f8e4a02-3fc5-442a-b116-22921e4d6495 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:31:34 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:31:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:31:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:31:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:50 user nova-compute[75235]: DEBUG nova.objects.instance [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:31:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:31:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:31:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:31:50 user nova-compute[75235]: INFO nova.compute.manager [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attaching volume 27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 to /dev/vdb
Nov 29 19:31:51 user nova-compute[75235]: DEBUG os_brick.utils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a01fe-6446-467e-af49-808e57be1327]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d7545-0b31-4069-82bd-6aef03e71ba8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d423ac1-4447-48a9-9b75-4b039c8d1071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2d6780-c640-44da-9d0e-fe74f8d7ce1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:31:51 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:31:51 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[913137b7-e84d-4eb8-aa68-dd1b6bbf5f80]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG os_brick.utils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating existing volume attachment record: 785ccbd0-2d68-4eb4-9d3f-8ac5f9302e8a {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:31:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaxHLmoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:31:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:31:58 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:31:58 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4c744d-6140-41fc-b7e6-0892503239e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:31:58 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be63f35-5ff8-4d1d-b00a-739d85932d86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59] added
Nov 29 19:31:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[974196d6-76ec-4da9-8f53-017eea2a1813]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[28490db0-7d43-4565-bdee-de23f7e2cf6c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaxHLmoN {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaxHLmoN" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3953c996-4c78-4cf1-9ff8-75df558cd3b0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaxHLmoN'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4111caf-3a1a-4f32-ae89-de47720e32f2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ce57e-ce9e-43a4-9d93-f41fec0459ab]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:31:58 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:31:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:31:58 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:31:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31aa41-31ce-499d-99bb-fba9aca4e80b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260]
Nov 29 19:31:58 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260] successful.
Nov 29 19:31:58 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4b4d6-6f9c-4d53-a5b0-55e7af4b9425]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:31:58 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17a8db3-c85a-465e-abe4-4302bb24b58c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:31:59 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:31:59 user nova-compute[75235]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 (non-flash)
Nov 29 19:31:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:31:59 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:31:59 user nova-compute[75235]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 (non-flash)
Nov 29 19:31:59 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f6a8e-96f7-4e92-bbb7-c29c7017084c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:31:59 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaxHLmoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23238303231333762', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238303231333762', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG nova.objects.instance [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:32:00 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:32:00 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:32:00 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:32:00 user nova-compute[75235]:   <serial>27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59</serial>
Nov 29 19:32:00 user nova-compute[75235]: </disk>
Nov 29 19:32:00 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No VIF found with MAC fa:16:3e:58:22:e3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:32:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-747677d9-b130-406e-bf77-58cb937a78b4 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.749s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:03 user nova-compute[75235]: INFO nova.compute.manager [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Detaching volume 27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59
Nov 29 19:32:03 user nova-compute[75235]: INFO nova.virt.block_device [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attempting to driver detach volume 27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 from mountpoint /dev/vdb
Nov 29 19:32:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Attempting to detach device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:32:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:32:03 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:32:03 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:32:03 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:32:03 user nova-compute[75235]:   <serial>27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59</serial>
Nov 29 19:32:03 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:32:03 user nova-compute[75235]: </disk>
Nov 29 19:32:03 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:32:03 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config.
Nov 29 19:32:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:32:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:32:03 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:32:03 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:32:03 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:32:03 user nova-compute[75235]:   <serial>27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59</serial>
Nov 29 19:32:03 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:32:03 user nova-compute[75235]: </disk>
Nov 29 19:32:03 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:32:03 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:32:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:09 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:09 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:32:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:15 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:32:16 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=25.086822509765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance f5f6210e-b04f-4920-9285-5177f5c2cada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 663ab537-b6c8-4465-a0b7-8c83de1bbe34 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:32:16 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:32:17 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:32:17 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:32:17 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:32:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:32:20 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:32:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:32:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:32:20 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:32:21 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:32:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:32:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:32:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:22 user nova-compute[75235]: INFO nova.compute.manager [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Detaching volume 59fdef9f-2618-4d70-b11c-abb43e637758
Nov 29 19:32:22 user nova-compute[75235]: INFO nova.virt.block_device [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Attempting to driver detach volume 59fdef9f-2618-4d70-b11c-abb43e637758 from mountpoint /dev/vdb
Nov 29 19:32:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Attempting to detach device vdb from instance f5f6210e-b04f-4920-9285-5177f5c2cada from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:32:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:32:22 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:32:22 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:32:22 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:32:22 user nova-compute[75235]:   <serial>59fdef9f-2618-4d70-b11c-abb43e637758</serial>
Nov 29 19:32:22 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:32:22 user nova-compute[75235]: </disk>
Nov 29 19:32:22 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:32:22 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully detached device vdb from instance f5f6210e-b04f-4920-9285-5177f5c2cada from the persistent domain config.
Nov 29 19:32:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5f6210e-b04f-4920-9285-5177f5c2cada from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:32:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:32:22 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:32:22 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:32:22 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:32:22 user nova-compute[75235]:   <serial>59fdef9f-2618-4d70-b11c-abb43e637758</serial>
Nov 29 19:32:22 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:32:22 user nova-compute[75235]: </disk>
Nov 29 19:32:22 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:32:22 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:32:23 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 is timed out.
Nov 29 19:32:23 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config.
Nov 29 19:32:23 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaxHLmoN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:32:23 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c7d115-0f60-40ca-81a7-bd603524fdf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:32:23 user nova-compute[75235]: No targets found.
Nov 29 19:32:23 user nova-compute[75235]: iSNS:
Nov 29 19:32:23 user nova-compute[75235]: No targets found.
Nov 29 19:32:23 user nova-compute[75235]: STATIC:
Nov 29 19:32:23 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758
Nov 29 19:32:23 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:32:23 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:32:23 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59
Nov 29 19:32:23 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:32:23 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:32:23 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:32:23 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:32:23 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:32:23 user nova-compute[75235]: FIRMWARE:
Nov 29 19:32:23 user nova-compute[75235]: No targets found.
Nov 29 19:32:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:32:23 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:32:23 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c852e53-85b6-4010-99a7-9fc77160b7f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5964ab6-bca4-40fa-a469-804bab37004d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:32:23 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:23 user nova-compute[75235]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 (non-flash)
Nov 29 19:32:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:32:23 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:23 user nova-compute[75235]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 (non-flash)
Nov 29 19:32:23 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56503ff910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbe580c-b8fb-422a-aaf9-e29ba3c1c75a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f3055-330e-48a0-bd3d-705c45c7fd63]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d5977-e26b-4adb-b569-55e4b174b848]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:32:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b196f2-d1b1-4797-89a1-391178f11ce1]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ccabb-8bfc-4c82-bb2e-6b4a0507f222]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc7fb5-7712-46c5-93eb-dcf03556366e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260]
Nov 29 19:32:24 user nova-compute[75235]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59, portal: 172.16.0.220,3260] successful.
Nov 29 19:32:24 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27521fa9-8bf1-4f45-a9fb-3ba75a0c0a59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf04e1f-6e53-4616-b268-d97d50887700]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== disconnect_volume: return (324ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:32:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e0eb57fc-5ccb-4c34-97a0-825eaf4159dc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:31 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:32:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:32:31 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:34 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-changed-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG nova.compute.manager [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Refreshing instance network info cache due to event network-changed-afab173b-1dda-4e85-8a9c-127b0ab40a57. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] Acquiring lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] Acquired lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG nova.network.neutron [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Refreshing network info cache for port afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG nova.network.neutron [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updated VIF entry in instance network info cache for port afab173b-1dda-4e85-8a9c-127b0ab40a57. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG nova.network.neutron [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-cff57840-44f9-49b9-b896-77c67ee8b879 req-6c97577f-540d-4846-8848-3437dcec35a4 service nova] Releasing lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:32:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:41 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:42 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5f6210e-b04f-4920-9285-5177f5c2cada is timed out.
Nov 29 19:32:42 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully detached device vdb from instance f5f6210e-b04f-4920-9285-5177f5c2cada from the live domain config.
Nov 29 19:32:42 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKixDPmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:32:42 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569d672-1519-4de8-9088-e1bb19a5cd9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:32:42 user nova-compute[75235]: No targets found.
Nov 29 19:32:42 user nova-compute[75235]: iSNS:
Nov 29 19:32:42 user nova-compute[75235]: No targets found.
Nov 29 19:32:42 user nova-compute[75235]: STATIC:
Nov 29 19:32:42 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758
Nov 29 19:32:42 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:32:42 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:32:42 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:32:42 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:32:42 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:32:42 user nova-compute[75235]: FIRMWARE:
Nov 29 19:32:42 user nova-compute[75235]: No targets found.
Nov 29 19:32:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:32:42 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:32:42 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7327671f-40fa-49c8-91de-5b62db2ac728]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d8f34e-3506-4062-a38a-9ab9523a2099]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:32:42 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 (non-flash)
Nov 29 19:32:42 user nova-compute[75235]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:42 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c5c65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db7bd01-4843-447e-95f8-f5c8e2346da9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fad7fd-df76-4a62-b3b1-d845533878cd]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac9ca1f-96ac-4ce0-9f72-a2d58377c506]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c4ea6-7cea-4f7b-be5a-543c115df7ff]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[312b623f-db44-461b-9ab5-ae6b3da238c0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:42 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaa852c-0b12-4437-9d95-67ec08d3ccae]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260]
Nov 29 19:32:43 user nova-compute[75235]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758, portal: 172.16.0.220,3260] successful.
Nov 29 19:32:43 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59fdef9f-2618-4d70-b11c-abb43e637758 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e6bf3-2abe-429f-a915-320bcde5dfe4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== disconnect_volume: return (311ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:32:43 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:32:44 user nova-compute[75235]: DEBUG nova.objects.instance [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:32:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-07143ea1-b4ac-4cf0-b77f-79c0b01f4a08 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:45 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "64941039-6df2-4347-8cef-ec06da35b564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:32:46 user nova-compute[75235]: INFO nova.compute.claims [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Claim successful on node user
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:32:46 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:32:46 user nova-compute[75235]: INFO nova.virt.block_device [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Booting with volume 6b9d46d1-41c3-4695-a290-3012ebd756a4 at /dev/vda
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.policy [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20d52323a014526b5ebd121d637f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e15c428b2f43b9a2e5850370c4f938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG os_brick.utils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[69657982-5520-47b4-ac37-7bf3324bb9b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d24ac-509c-4b39-b4fa-f69ccce2e2db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1110c33-3943-4cef-a33a-06f0d367f476]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc895914-b7ab-4c40-a5e2-20afa04a6e15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:32:46 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:32:46 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f856714-b5bf-4598-8c01-27daa7194106]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG os_brick.utils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:32:46 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating existing volume attachment record: f623a5d0-e0f8-44f1-9bcd-ec9bf0c07ac9 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Successfully created port: ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Successfully updated port: ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquired lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-changed-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG nova.compute.manager [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Refreshing instance network info cache due to event network-changed-ad3611d6-531e-4f50-97d4-3b80a844bca7. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:32:47 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] Acquiring lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG nova.network.neutron [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating instance_info_cache with network_info: [{"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Releasing lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Instance network_info: |[{"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] Acquired lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Refreshing network info cache for port ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updated VIF entry in instance network info cache for port ad3611d6-531e-4f50-97d4-3b80a844bca7. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG nova.network.neutron [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating instance_info_cache with network_info: [{"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:32:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-6dc23f67-0c51-4c47-9d0a-844d502daa1f req-09cfa67e-18ac-42ec-a0ba-005c47dca3d1 service nova] Releasing lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:32:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:32:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:32:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:32:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:32:54 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Creating image(s)
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Did not create local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Ensure instance console log exists: /opt/stack/data/nova/instances/64941039-6df2-4347-8cef-ec06da35b564/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Start _get_guest_xml network_info=[{"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'f623a5d0-e0f8-44f1-9bcd-ec9bf0c07ac9', 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKDbgzRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64941039-6df2-4347-8cef-ec06da35b564', 'attached_at': '', 'detached_at': '', 'volume_id': '6b9d46d1-41c3-4695-a290-3012ebd756a4', 'serial': '6b9d46d1-41c3-4695-a290-3012ebd756a4'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:32:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:32:54 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKDbgzRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:32:54 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:32:54 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:32:54 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec50eb-e198-48b9-a23f-e1ab90eb1b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:32:54 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd91bd2c-583e-4b93-8712-07c0fb889a11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4] added
Nov 29 19:32:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57ea4d-c9c2-49e6-b16b-57090392c764]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[351269c0-96f0-4573-bd71-3ae913a5ba05]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKDbgzRL {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nKDbgzRL" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[44820068-2aab-4b87-a95d-ccfb0f591475]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nKDbgzRL'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8886efe2-f381-4584-88d9-c8396a2b89df]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d12023-cc89-4953-97d9-7a41acad87ef]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[068b3bf7-b4fe-43f3-a185-d75679fd1f4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260]
Nov 29 19:32:54 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260] successful.
Nov 29 19:32:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951426e-a98e-451d-9519-7c7cfd94b856]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2fe538-743b-4137-8857-fdb7cc2f7f91]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:54 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:32:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:32:54 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:32:54 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1948fd0f-0272-432b-acde-3e797bcbef2d]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:54 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKDbgzRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23163343566366435', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163343566366435', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2071810289',display_name='tempest-TestVolumeBootPattern-server-2071810289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2071810289',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-kfpn82ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:32:47Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=64941039-6df2-4347-8cef-ec06da35b564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.objects.instance [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'pci_devices' on Instance uuid 64941039-6df2-4347-8cef-ec06da35b564 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:32:55 user nova-compute[75235]:   <uuid>64941039-6df2-4347-8cef-ec06da35b564</uuid>
Nov 29 19:32:55 user nova-compute[75235]:   <name>instance-00000032</name>
Nov 29 19:32:55 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:32:55 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:32:55 user nova-compute[75235]:   <metadata>
Nov 29 19:32:55 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:32:55 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:32:55 user nova-compute[75235]:       <nova:name>tempest-TestVolumeBootPattern-server-2071810289</nova:name>
Nov 29 19:32:55 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:32:54</nova:creationTime>
Nov 29 19:32:55 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:32:55 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:32:55 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:32:55 user nova-compute[75235]:       <nova:owner>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:user uuid="f20d52323a014526b5ebd121d637f4c4">tempest-TestVolumeBootPattern-656128499-project-member</nova:user>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:project uuid="87e15c428b2f43b9a2e5850370c4f938">tempest-TestVolumeBootPattern-656128499</nova:project>
Nov 29 19:32:55 user nova-compute[75235]:       </nova:owner>
Nov 29 19:32:55 user nova-compute[75235]:       <nova:ports>
Nov 29 19:32:55 user nova-compute[75235]:         <nova:port uuid="ad3611d6-531e-4f50-97d4-3b80a844bca7">
Nov 29 19:32:55 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 19:32:55 user nova-compute[75235]:         </nova:port>
Nov 29 19:32:55 user nova-compute[75235]:       </nova:ports>
Nov 29 19:32:55 user nova-compute[75235]:     </nova:instance>
Nov 29 19:32:55 user nova-compute[75235]:   </metadata>
Nov 29 19:32:55 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:32:55 user nova-compute[75235]:     <system>
Nov 29 19:32:55 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:32:55 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:32:55 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:32:55 user nova-compute[75235]:       <entry name="serial">64941039-6df2-4347-8cef-ec06da35b564</entry>
Nov 29 19:32:55 user nova-compute[75235]:       <entry name="uuid">64941039-6df2-4347-8cef-ec06da35b564</entry>
Nov 29 19:32:55 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:32:55 user nova-compute[75235]:     </system>
Nov 29 19:32:55 user nova-compute[75235]:   </sysinfo>
Nov 29 19:32:55 user nova-compute[75235]:   <os>
Nov 29 19:32:55 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:32:55 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:32:55 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:32:55 user nova-compute[75235]:   </os>
Nov 29 19:32:55 user nova-compute[75235]:   <features>
Nov 29 19:32:55 user nova-compute[75235]:     <acpi/>
Nov 29 19:32:55 user nova-compute[75235]:     <apic/>
Nov 29 19:32:55 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:32:55 user nova-compute[75235]:   </features>
Nov 29 19:32:55 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:32:55 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:32:55 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:32:55 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:32:55 user nova-compute[75235]:   </clock>
Nov 29 19:32:55 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:32:55 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:32:55 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:32:55 user nova-compute[75235]:   </cpu>
Nov 29 19:32:55 user nova-compute[75235]:   <devices>
Nov 29 19:32:55 user nova-compute[75235]:     <disk type="block" device="disk">
Nov 29 19:32:55 user nova-compute[75235]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:32:55 user nova-compute[75235]:       <source dev="/dev/sdb"/>
Nov 29 19:32:55 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:32:55 user nova-compute[75235]:       <serial>6b9d46d1-41c3-4695-a290-3012ebd756a4</serial>
Nov 29 19:32:55 user nova-compute[75235]:     </disk>
Nov 29 19:32:55 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:32:55 user nova-compute[75235]:       <mac address="fa:16:3e:a8:05:24"/>
Nov 29 19:32:55 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:32:55 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:32:55 user nova-compute[75235]:       <target dev="tapad3611d6-53"/>
Nov 29 19:32:55 user nova-compute[75235]:     </interface>
Nov 29 19:32:55 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:32:55 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/64941039-6df2-4347-8cef-ec06da35b564/console.log" append="off"/>
Nov 29 19:32:55 user nova-compute[75235]:     </serial>
Nov 29 19:32:55 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:32:55 user nova-compute[75235]:     <video>
Nov 29 19:32:55 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:32:55 user nova-compute[75235]:     </video>
Nov 29 19:32:55 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:32:55 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:32:55 user nova-compute[75235]:     </rng>
Nov 29 19:32:55 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:32:55 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:32:55 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:32:55 user nova-compute[75235]:     </memballoon>
Nov 29 19:32:55 user nova-compute[75235]:   </devices>
Nov 29 19:32:55 user nova-compute[75235]: </domain>
Nov 29 19:32:55 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2071810289',display_name='tempest-TestVolumeBootPattern-server-2071810289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2071810289',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-kfpn82ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:32:47Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=64941039-6df2-4347-8cef-ec06da35b564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG os_vif [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50759b7d-79d9-5c7b-b680-e04ffbc8d99e', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad3611d6-53, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad3611d6-53, col_values=(('qos', UUID('ca9f5fbd-1cf0-49c1-abce-b2ce4ae4e81b')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad3611d6-53, col_values=(('external_ids', {'iface-id': 'ad3611d6-531e-4f50-97d4-3b80a844bca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:05:24', 'vm-uuid': '64941039-6df2-4347-8cef-ec06da35b564'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:55 user nova-compute[75235]: INFO os_vif [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53')
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:32:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] No VIF found with MAC fa:16:3e:a8:05:24, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:56 user nova-compute[75235]: INFO nova.compute.manager [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attaching volume f6d3c6c4-b0a7-4797-961c-248d2e6f6057 to /dev/vdb
Nov 29 19:32:56 user nova-compute[75235]: DEBUG os_brick.utils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0885b104-5537-4d45-a01e-6c7ba1d5235e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[73863481-6bb6-4133-bd3e-2c8fa84e0724]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[38713343-f9d2-42d8-82c7-dcab87e422c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089b16a-2332-4367-bc1f-45877a41e586]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:32:56 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:32:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa08cf2-33ba-419b-a54d-bfa4c47c4976]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG os_brick.utils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:32:56 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating existing volume attachment record: f7e05580-b77a-48de-ab93-c52c3fdb3c08 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-0b9b6038-b2e9-4cd4-86dd-5610c7df2df5 req-cf39a3c5-1ca8-4088-b787-ffa5ef296954 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b9b6038-b2e9-4cd4-86dd-5610c7df2df5 req-cf39a3c5-1ca8-4088-b787-ffa5ef296954 service nova] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b9b6038-b2e9-4cd4-86dd-5610c7df2df5 req-cf39a3c5-1ca8-4088-b787-ffa5ef296954 service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0b9b6038-b2e9-4cd4-86dd-5610c7df2df5 req-cf39a3c5-1ca8-4088-b787-ffa5ef296954 service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-0b9b6038-b2e9-4cd4-86dd-5610c7df2df5 req-cf39a3c5-1ca8-4088-b787-ffa5ef296954 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] No waiting events found dispatching network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:32:57 user nova-compute[75235]: WARNING nova.compute.manager [req-0b9b6038-b2e9-4cd4-86dd-5610c7df2df5 req-cf39a3c5-1ca8-4088-b787-ffa5ef296954 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received unexpected event network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 for instance with vm_state building and task_state spawning.
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:32:59 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Instance spawned successfully.
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:32:59 user nova-compute[75235]: INFO nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:32:59 user nova-compute[75235]: INFO nova.compute.manager [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Took 13.41 seconds to build instance.
Nov 29 19:32:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7acd0a-ca9b-4a18-a164-a250a08919fe tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "64941039-6df2-4347-8cef-ec06da35b564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.511s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-70810623-cc28-4ab8-bc0b-4a54ac8ad783 req-b5696240-af77-41e6-8798-442cce62f7b0 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-70810623-cc28-4ab8-bc0b-4a54ac8ad783 req-b5696240-af77-41e6-8798-442cce62f7b0 service nova] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-70810623-cc28-4ab8-bc0b-4a54ac8ad783 req-b5696240-af77-41e6-8798-442cce62f7b0 service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-70810623-cc28-4ab8-bc0b-4a54ac8ad783 req-b5696240-af77-41e6-8798-442cce62f7b0 service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:32:59 user nova-compute[75235]: DEBUG nova.compute.manager [req-70810623-cc28-4ab8-bc0b-4a54ac8ad783 req-b5696240-af77-41e6-8798-442cce62f7b0 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] No waiting events found dispatching network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:32:59 user nova-compute[75235]: WARNING nova.compute.manager [req-70810623-cc28-4ab8-bc0b-4a54ac8ad783 req-b5696240-af77-41e6-8798-442cce62f7b0 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received unexpected event network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 for instance with vm_state active and task_state None.
Nov 29 19:33:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diLoXBnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:33:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:33:04 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:33:04 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc58d02-4ca0-48a2-b768-27ffffb47c28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:33:04 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45ef929-53d2-42e6-9875-6a6d847051ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057] added
Nov 29 19:33:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[69983f3b-b23f-4c00-8957-22a5f3219f9c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b0062-5a32-49ad-a067-429b573b80b0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v diLoXBnT {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v diLoXBnT" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9108b-9242-44b0-aa74-4f1c92ef2609]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'diLoXBnT'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fb02bd-926b-4c95-a3d6-f1f8e80efc97]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42dd94-8f80-4945-a343-2d0e2f691c1d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:33:04 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:33:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:33:04 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:33:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ecb779-32b5-4c93-90b2-9f9068a4ad31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260]
Nov 29 19:33:04 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260] successful.
Nov 29 19:33:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72055b78-8491-4ecf-bb89-b2396c3042b9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ab9054-df36-4e78-a79b-f9082c89c124]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:33:04 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:33:04 user nova-compute[75235]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 (non-flash)
Nov 29 19:33:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:33:04 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:33:04 user nova-compute[75235]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 (non-flash)
Nov 29 19:33:04 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa7183a-ef1f-4f72-9a2e-59c774a58816]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:33:04 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diLoXBnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23730363430333134', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730363430333134', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG nova.objects.instance [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:33:05 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:33:05 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:33:05 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:33:05 user nova-compute[75235]:   <serial>f6d3c6c4-b0a7-4797-961c-248d2e6f6057</serial>
Nov 29 19:33:05 user nova-compute[75235]: </disk>
Nov 29 19:33:05 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:33:05 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No VIF found with MAC fa:16:3e:58:22:e3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:33:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-2173a57f-8a96-4d12-8c72-17a7020c43bc tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.662s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:08 user nova-compute[75235]: INFO nova.compute.manager [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Detaching volume f6d3c6c4-b0a7-4797-961c-248d2e6f6057
Nov 29 19:33:08 user nova-compute[75235]: INFO nova.virt.block_device [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attempting to driver detach volume f6d3c6c4-b0a7-4797-961c-248d2e6f6057 from mountpoint /dev/vdb
Nov 29 19:33:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Attempting to detach device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:33:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:33:08 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:33:08 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:33:08 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:33:08 user nova-compute[75235]:   <serial>f6d3c6c4-b0a7-4797-961c-248d2e6f6057</serial>
Nov 29 19:33:08 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:33:08 user nova-compute[75235]: </disk>
Nov 29 19:33:08 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:33:08 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config.
Nov 29 19:33:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:33:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:33:08 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:33:08 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:33:08 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:33:08 user nova-compute[75235]:   <serial>f6d3c6c4-b0a7-4797-961c-248d2e6f6057</serial>
Nov 29 19:33:08 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:33:08 user nova-compute[75235]: </disk>
Nov 29 19:33:08 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:33:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:33:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:12 user nova-compute[75235]: INFO nova.compute.manager [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Terminating instance
Nov 29 19:33:12 user nova-compute[75235]: DEBUG nova.compute.manager [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-caeb12d2-fd1c-4416-99b2-d5bdf5bdfcb5 req-e752f105-b372-45cd-a523-bcd7a7e778e9 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-unplugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-caeb12d2-fd1c-4416-99b2-d5bdf5bdfcb5 req-e752f105-b372-45cd-a523-bcd7a7e778e9 service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-caeb12d2-fd1c-4416-99b2-d5bdf5bdfcb5 req-e752f105-b372-45cd-a523-bcd7a7e778e9 service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-caeb12d2-fd1c-4416-99b2-d5bdf5bdfcb5 req-e752f105-b372-45cd-a523-bcd7a7e778e9 service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-caeb12d2-fd1c-4416-99b2-d5bdf5bdfcb5 req-e752f105-b372-45cd-a523-bcd7a7e778e9 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-unplugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:33:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-caeb12d2-fd1c-4416-99b2-d5bdf5bdfcb5 req-e752f105-b372-45cd-a523-bcd7a7e778e9 service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-unplugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Instance destroyed successfully.
Nov 29 19:33:13 user nova-compute[75235]: DEBUG nova.objects.instance [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'resources' on Instance uuid f5f6210e-b04f-4920-9285-5177f5c2cada {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-611547369',display_name='tempest-AttachVolumeNegativeTest-server-611547369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-611547369',id=45,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9dnfQ02e7RNR+qCoeWVJvcBI46ruh49FtR918F9dLRnb2PURrs7xOQ9aKOenPZ5dOMip7Mynq0KwUtFm/CzttMbRclueWsqmojmgl+0oUDmRetx7OHjuEkgvUvOk9ZUQ==',key_name='tempest-keypair-2052833185',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:27:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-aca81tnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=f5f6210e-b04f-4920-9285-5177f5c2cada,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "address": "fa:16:3e:87:38:f9", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dc53f98-6c", "ovs_interfaceid": "2dc53f98-6cde-4e3d-9f55-cf9234cb99a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG os_vif [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dc53f98-6c, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7571c24d-b94e-49b9-89b7-56e5c4561392) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:33:13 user nova-compute[75235]: INFO os_vif [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:38:f9,bridge_name='br-int',has_traffic_filtering=True,id=2dc53f98-6cde-4e3d-9f55-cf9234cb99a9,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dc53f98-6c')
Nov 29 19:33:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Deleting instance files /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada_del
Nov 29 19:33:13 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Deletion of /opt/stack/data/nova/instances/f5f6210e-b04f-4920-9285-5177f5c2cada_del complete
Nov 29 19:33:13 user nova-compute[75235]: INFO nova.compute.manager [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 19:33:13 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:33:14 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Took 1.29 seconds to deallocate network for instance.
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:33:14 user nova-compute[75235]: WARNING nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received unexpected event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with vm_state active and task_state deleting.
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:33:14 user nova-compute[75235]: WARNING nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received unexpected event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with vm_state active and task_state deleting.
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:33:14 user nova-compute[75235]: WARNING nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received unexpected event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with vm_state active and task_state deleting.
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-unplugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-unplugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-unplugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Acquiring lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] No waiting events found dispatching network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:33:14 user nova-compute[75235]: WARNING nova.compute.manager [req-d0a2ec57-c486-40bd-931f-2132de12a733 req-337c7a3c-a818-44b0-bdbb-54de2542577f service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received unexpected event network-vif-plugged-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 for instance with vm_state active and task_state deleting.
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.manager [req-9d1ae943-aa65-4414-aba2-0047d5f1f1f2 req-b68ed055-dd47-4959-9622-45b3aa42f64e service nova] [instance: f5f6210e-b04f-4920-9285-5177f5c2cada] Received event network-vif-deleted-2dc53f98-6cde-4e3d-9f55-cf9234cb99a9 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:33:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:15 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Deleted allocations for instance f5f6210e-b04f-4920-9285-5177f5c2cada
Nov 29 19:33:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:15 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-85d05a3a-cd92-4b7b-9e8a-88d81648b97d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "f5f6210e-b04f-4920-9285-5177f5c2cada" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.585s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:17 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:18 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:33:18 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.11206817626953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 663ab537-b6c8-4465-a0b7-8c83de1bbe34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 64941039-6df2-4347-8cef-ec06da35b564 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:33:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:33:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:22 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:33:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:33:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:33:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:33:23 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:33:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:33:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:33:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:29 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 is timed out.
Nov 29 19:33:29 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config.
Nov 29 19:33:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diLoXBnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:33:29 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ce9b0-1630-40ed-b849-ac9cd129bbe5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:33:29 user nova-compute[75235]: No targets found.
Nov 29 19:33:29 user nova-compute[75235]: iSNS:
Nov 29 19:33:29 user nova-compute[75235]: No targets found.
Nov 29 19:33:29 user nova-compute[75235]: STATIC:
Nov 29 19:33:29 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057
Nov 29 19:33:29 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:33:29 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:33:29 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4
Nov 29 19:33:29 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:33:29 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:33:29 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:33:29 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:33:29 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:33:29 user nova-compute[75235]: FIRMWARE:
Nov 29 19:33:29 user nova-compute[75235]: No targets found.
Nov 29 19:33:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:33:29 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:33:29 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0e00ac-b926-4071-81d3-1d6986fbf563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eda5cc-faf4-42c4-bd47-2c6e619643d2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:33:29 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:33:29 user nova-compute[75235]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 (non-flash)
Nov 29 19:33:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:33:29 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:33:29 user nova-compute[75235]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 (non-flash)
Nov 29 19:33:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56505175b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5cb129-5b81-4152-9f53-d9fc62a09823]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d376dd-c102-4b9d-9e8f-db81b9e51b4e]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f2791-d610-4763-a771-15eace5d7775]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[83135b82-6e9f-4225-abc2-4244cdbf2739]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dff11b-a222-48fe-9462-623c06167731]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5994e5-2721-47bb-b5f6-524cdb84bebd]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260]
Nov 29 19:33:29 user nova-compute[75235]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057, portal: 172.16.0.220,3260] successful.
Nov 29 19:33:29 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6d3c6c4-b0a7-4797-961c-248d2e6f6057 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4d403b-cad4-4983-a1d1-3011d83ffd28]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== disconnect_volume: return (306ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:33:29 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:33:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:30 user nova-compute[75235]: DEBUG nova.objects.instance [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:33:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-0e475b19-7a5a-49dd-b00d-29b54724c281 tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:33:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:35 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:33:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:43 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:48 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:53 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:33:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:33:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:33:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:33:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:33:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:33:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:02 user nova-compute[75235]: INFO nova.compute.manager [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attaching volume a2d56fe6-ae76-4875-b179-bffd91e4b708 to /dev/vdb
Nov 29 19:34:02 user nova-compute[75235]: DEBUG os_brick.utils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137a075-1ae8-463d-a8cb-eb261b22b638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b05a47f-82af-41aa-a102-525d22d608a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53cf334-38a2-497b-8461-49938ee13cc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa4236-cc62-4bc3-8832-c173438b944d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:34:02 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:34:02 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa0b14-4bef-4249-8c63-4ee3db96ed65]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG os_brick.utils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:34:02 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating existing volume attachment record: b760786b-16d3-4435-a937-fb8e4f576227 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:34:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:03 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:34:06 user nova-compute[75235]: INFO nova.compute.claims [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Claim successful on node user
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:34:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.policy [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c44ac18976b4232a45bedacf9177023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2594a91424a6408a9c6c57d5364bc9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:34:06 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Creating image(s)
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.204s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:06 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk 1073741824" returned: 0 in 0.059s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Successfully created port: ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Cannot resize image /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Ensure instance console log exists: /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Successfully updated port: ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquired lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-changed-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.compute.manager [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Refreshing instance network info cache due to event network-changed-ad0831bf-3799-45b7-ad65-1b313c2b35b0. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] Acquiring lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:34:07 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.neutron [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updating instance_info_cache with network_info: [{"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Releasing lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Instance network_info: |[{"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] Acquired lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.neutron [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Refreshing network info cache for port ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Start _get_guest_xml network_info=[{"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:34:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:34:08 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1386282348',display_name='tempest-AttachVolumeNegativeTest-server-1386282348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1386282348',id=51,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2X6C/qixrPnJm7B5Y+qqjBGmgWxhFXHV8pyQZz/+VPgPkg4TLKzXWV+Sqg5FrN8XllfuIGj+ocqc5c74JEKW4JaDcSdL4i8rVqxNvsyXBXT73DIGgOWEWs+7pTOFrrzw==',key_name='tempest-keypair-1772602022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-hnfrlvmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=4b7afeb1-3e44-4489-a3a8-09d6304d64d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.objects.instance [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:34:08 user nova-compute[75235]:   <uuid>4b7afeb1-3e44-4489-a3a8-09d6304d64d3</uuid>
Nov 29 19:34:08 user nova-compute[75235]:   <name>instance-00000033</name>
Nov 29 19:34:08 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:34:08 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:34:08 user nova-compute[75235]:   <metadata>
Nov 29 19:34:08 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:34:08 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:34:08 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1386282348</nova:name>
Nov 29 19:34:08 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:34:08</nova:creationTime>
Nov 29 19:34:08 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:34:08 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:34:08 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:34:08 user nova-compute[75235]:       <nova:owner>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:user uuid="4c44ac18976b4232a45bedacf9177023">tempest-AttachVolumeNegativeTest-1078373175-project-member</nova:user>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:project uuid="2594a91424a6408a9c6c57d5364bc9bb">tempest-AttachVolumeNegativeTest-1078373175</nova:project>
Nov 29 19:34:08 user nova-compute[75235]:       </nova:owner>
Nov 29 19:34:08 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:34:08 user nova-compute[75235]:       <nova:ports>
Nov 29 19:34:08 user nova-compute[75235]:         <nova:port uuid="ad0831bf-3799-45b7-ad65-1b313c2b35b0">
Nov 29 19:34:08 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 19:34:08 user nova-compute[75235]:         </nova:port>
Nov 29 19:34:08 user nova-compute[75235]:       </nova:ports>
Nov 29 19:34:08 user nova-compute[75235]:     </nova:instance>
Nov 29 19:34:08 user nova-compute[75235]:   </metadata>
Nov 29 19:34:08 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:34:08 user nova-compute[75235]:     <system>
Nov 29 19:34:08 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:34:08 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:34:08 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:34:08 user nova-compute[75235]:       <entry name="serial">4b7afeb1-3e44-4489-a3a8-09d6304d64d3</entry>
Nov 29 19:34:08 user nova-compute[75235]:       <entry name="uuid">4b7afeb1-3e44-4489-a3a8-09d6304d64d3</entry>
Nov 29 19:34:08 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:34:08 user nova-compute[75235]:     </system>
Nov 29 19:34:08 user nova-compute[75235]:   </sysinfo>
Nov 29 19:34:08 user nova-compute[75235]:   <os>
Nov 29 19:34:08 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:34:08 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:34:08 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:34:08 user nova-compute[75235]:   </os>
Nov 29 19:34:08 user nova-compute[75235]:   <features>
Nov 29 19:34:08 user nova-compute[75235]:     <acpi/>
Nov 29 19:34:08 user nova-compute[75235]:     <apic/>
Nov 29 19:34:08 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:34:08 user nova-compute[75235]:   </features>
Nov 29 19:34:08 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:34:08 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:34:08 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:34:08 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:34:08 user nova-compute[75235]:   </clock>
Nov 29 19:34:08 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:34:08 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:34:08 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:34:08 user nova-compute[75235]:   </cpu>
Nov 29 19:34:08 user nova-compute[75235]:   <devices>
Nov 29 19:34:08 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:34:08 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:34:08 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk"/>
Nov 29 19:34:08 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:34:08 user nova-compute[75235]:     </disk>
Nov 29 19:34:08 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:34:08 user nova-compute[75235]:       <mac address="fa:16:3e:62:16:0a"/>
Nov 29 19:34:08 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:34:08 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:34:08 user nova-compute[75235]:       <target dev="tapad0831bf-37"/>
Nov 29 19:34:08 user nova-compute[75235]:     </interface>
Nov 29 19:34:08 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:34:08 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/console.log" append="off"/>
Nov 29 19:34:08 user nova-compute[75235]:     </serial>
Nov 29 19:34:08 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:34:08 user nova-compute[75235]:     <video>
Nov 29 19:34:08 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:34:08 user nova-compute[75235]:     </video>
Nov 29 19:34:08 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:34:08 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:34:08 user nova-compute[75235]:     </rng>
Nov 29 19:34:08 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:34:08 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:34:08 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:34:08 user nova-compute[75235]:     </memballoon>
Nov 29 19:34:08 user nova-compute[75235]:   </devices>
Nov 29 19:34:08 user nova-compute[75235]: </domain>
Nov 29 19:34:08 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1386282348',display_name='tempest-AttachVolumeNegativeTest-server-1386282348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1386282348',id=51,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2X6C/qixrPnJm7B5Y+qqjBGmgWxhFXHV8pyQZz/+VPgPkg4TLKzXWV+Sqg5FrN8XllfuIGj+ocqc5c74JEKW4JaDcSdL4i8rVqxNvsyXBXT73DIGgOWEWs+7pTOFrrzw==',key_name='tempest-keypair-1772602022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-hnfrlvmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=4b7afeb1-3e44-4489-a3a8-09d6304d64d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG os_vif [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a371fa7-1ca0-559b-a885-c78a5041008c', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad0831bf-37, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad0831bf-37, col_values=(('qos', UUID('17432d9e-03b8-4461-bec2-625b7f04e551')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad0831bf-37, col_values=(('external_ids', {'iface-id': 'ad0831bf-3799-45b7-ad65-1b313c2b35b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:16:0a', 'vm-uuid': '4b7afeb1-3e44-4489-a3a8-09d6304d64d3'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:08 user nova-compute[75235]: INFO os_vif [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37')
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:62:16:0a, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.neutron [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updated VIF entry in instance network info cache for port ad0831bf-3799-45b7-ad65-1b313c2b35b0. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG nova.network.neutron [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updating instance_info_cache with network_info: [{"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:08 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-ac394e9a-e603-40ac-be64-011a2fcdf816 req-95e023c2-fc62-4c07-894f-d730df7264ed service nova] Releasing lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-88f9f167-bdcf-457e-a13c-b06c09395ba5 req-3988b7bb-e096-4882-bb8e-a801f1bbeaa7 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-88f9f167-bdcf-457e-a13c-b06c09395ba5 req-3988b7bb-e096-4882-bb8e-a801f1bbeaa7 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-88f9f167-bdcf-457e-a13c-b06c09395ba5 req-3988b7bb-e096-4882-bb8e-a801f1bbeaa7 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-88f9f167-bdcf-457e-a13c-b06c09395ba5 req-3988b7bb-e096-4882-bb8e-a801f1bbeaa7 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:09 user nova-compute[75235]: DEBUG nova.compute.manager [req-88f9f167-bdcf-457e-a13c-b06c09395ba5 req-3988b7bb-e096-4882-bb8e-a801f1bbeaa7 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:34:09 user nova-compute[75235]: WARNING nova.compute.manager [req-88f9f167-bdcf-457e-a13c-b06c09395ba5 req-3988b7bb-e096-4882-bb8e-a801f1bbeaa7 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received unexpected event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with vm_state building and task_state spawning.
Nov 29 19:34:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZbhBFIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:34:10 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:34:10 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:34:10 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7d133c-3c9f-45d2-9a24-c8eeb717e09d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:34:10 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a5c5fa-edee-49aa-9e6f-d18dcac0e9bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708] added
Nov 29 19:34:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a99d75-87c4-42eb-a46c-03dfd8e5bc9f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dacc92-5019-47a3-b2c2-e5624aff2a9d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZbhBFIC {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZbhBFIC" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5ae36-d578-4ae9-ac4d-9e82ba725033]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZbhBFIC'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9853ff8e-9be0-49f3-9d87-a1cd9399c01e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[670bee8c-680b-4f92-9156-b2c972170a91]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:10 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:10 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d64880e-463f-4f4d-898c-bb6b5bd17322]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260]
Nov 29 19:34:10 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260] successful.
Nov 29 19:34:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a030ad54-8f26-49db-ba7d-723959b0c720]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fbbb23-eecd-4fe1-a0f9-1595ca237e7d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:10 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:10 user nova-compute[75235]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 (non-flash)
Nov 29 19:34:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:10 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:10 user nova-compute[75235]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 (non-flash)
Nov 29 19:34:10 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e6b0b-1f43-471f-9f66-dc23e9cdb33c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:10 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZbhBFIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23834363036326435', 'path': '/dev/sdc'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834363036326435', 'path': '/dev/sdc'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.objects.instance [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:34:11 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:34:11 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:34:11 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:34:11 user nova-compute[75235]:   <serial>a2d56fe6-ae76-4875-b179-bffd91e4b708</serial>
Nov 29 19:34:11 user nova-compute[75235]: </disk>
Nov 29 19:34:11 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:34:11 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Instance spawned successfully.
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:34:11 user nova-compute[75235]: INFO nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] No VIF found with MAC fa:16:3e:58:22:e3, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:34:11 user nova-compute[75235]: INFO nova.compute.manager [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Took 5.88 seconds to build instance.
Nov 29 19:34:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-c473aaac-df6a-4e55-9e2a-5d938eb4aea6 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.974s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:11 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-e3478651-a46e-4be8-888c-0c0e93625a9b tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.719s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-9c11c3f5-b4f6-4ded-8523-5355ae049b5c req-c49036d2-ccac-4c45-a776-de676071f907 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9c11c3f5-b4f6-4ded-8523-5355ae049b5c req-c49036d2-ccac-4c45-a776-de676071f907 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9c11c3f5-b4f6-4ded-8523-5355ae049b5c req-c49036d2-ccac-4c45-a776-de676071f907 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:12 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9c11c3f5-b4f6-4ded-8523-5355ae049b5c req-c49036d2-ccac-4c45-a776-de676071f907 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:12 user nova-compute[75235]: DEBUG nova.compute.manager [req-9c11c3f5-b4f6-4ded-8523-5355ae049b5c req-c49036d2-ccac-4c45-a776-de676071f907 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:34:12 user nova-compute[75235]: WARNING nova.compute.manager [req-9c11c3f5-b4f6-4ded-8523-5355ae049b5c req-c49036d2-ccac-4c45-a776-de676071f907 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received unexpected event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with vm_state active and task_state None.
Nov 29 19:34:13 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:14 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:14 user nova-compute[75235]: INFO nova.compute.manager [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Detaching volume a2d56fe6-ae76-4875-b179-bffd91e4b708
Nov 29 19:34:14 user nova-compute[75235]: INFO nova.virt.block_device [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Attempting to driver detach volume a2d56fe6-ae76-4875-b179-bffd91e4b708 from mountpoint /dev/vdb
Nov 29 19:34:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Attempting to detach device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:34:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:34:14 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:34:14 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:34:14 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:34:14 user nova-compute[75235]:   <serial>a2d56fe6-ae76-4875-b179-bffd91e4b708</serial>
Nov 29 19:34:14 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:34:14 user nova-compute[75235]: </disk>
Nov 29 19:34:14 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:34:14 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the persistent domain config.
Nov 29 19:34:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:34:14 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:34:14 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:34:14 user nova-compute[75235]:   <source dev="/dev/sdc"/>
Nov 29 19:34:14 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:34:14 user nova-compute[75235]:   <serial>a2d56fe6-ae76-4875-b179-bffd91e4b708</serial>
Nov 29 19:34:14 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:34:14 user nova-compute[75235]: </disk>
Nov 29 19:34:14 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:34:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:15 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:34:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:18 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:19 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:34:19 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.109661102294922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 663ab537-b6c8-4465-a0b7-8c83de1bbe34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 64941039-6df2-4347-8cef-ec06da35b564 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:34:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:34:20 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:34:20 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:34:20 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:34:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:21 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:34:22 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [{"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-1781069c-646e-439c-a4b6-583e11a56b50" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:28 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:34:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:35 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1781069c-646e-439c-a4b6-583e11a56b50 is timed out.
Nov 29 19:34:35 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully detached device vdb from instance 1781069c-646e-439c-a4b6-583e11a56b50 from the live domain config.
Nov 29 19:34:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZbhBFIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:34:35 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e837253d-6cae-40bb-9071-5794becccf22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:34:35 user nova-compute[75235]: No targets found.
Nov 29 19:34:35 user nova-compute[75235]: iSNS:
Nov 29 19:34:35 user nova-compute[75235]: No targets found.
Nov 29 19:34:35 user nova-compute[75235]: STATIC:
Nov 29 19:34:35 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4
Nov 29 19:34:35 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:34:35 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:34:35 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:34:35 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:34:35 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:34:35 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708
Nov 29 19:34:35 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:34:35 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:34:35 user nova-compute[75235]: FIRMWARE:
Nov 29 19:34:35 user nova-compute[75235]: No targets found.
Nov 29 19:34:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:34:35 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:34:35 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896de75-3693-4ccf-9108-cff5d3052998]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc47134a-4da5-49c3-aad5-956a80bd3764]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:35 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:35 user nova-compute[75235]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 (non-flash)
Nov 29 19:34:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:35 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:35 user nova-compute[75235]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 (non-flash)
Nov 29 19:34:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f56507b05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708'): ({'sdc'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Removing single pathed devices sdc {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b5533-6d93-40c0-be03-91ccaaaa8efe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3d60d-1b10-42ef-8730-ae2a2b40b2c7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Flushing IO for device /dev/sdc {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3b7e83-0343-4c16-b94a-d66cffdd4da3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1dfd97-492f-4093-bb68-bd731cfa5bce]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] SCSI volumes sdc have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18cc4d0-947c-4428-a36b-d99fb67569ae]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5566a1a0-b722-4ad0-b3ef-9e7700af9ad9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260]
Nov 29 19:34:35 user nova-compute[75235]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708, portal: 172.16.0.220,3260] successful.
Nov 29 19:34:35 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d56fe6-ae76-4875-b179-bffd91e4b708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a280a46-b09e-44db-960d-acc454613bd3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] <== disconnect_volume: return (289ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:34:35 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:34:36 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'flavor' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:34:36 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7e3feb7f-7042-48e5-be16-53b94dbb5daf tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-changed-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Refreshing instance network info cache due to event network-changed-ad3611d6-531e-4f50-97d4-3b80a844bca7. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] Acquiring lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] Acquired lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Refreshing network info cache for port ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updated VIF entry in instance network info cache for port ad3611d6-531e-4f50-97d4-3b80a844bca7. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG nova.network.neutron [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating instance_info_cache with network_info: [{"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-239adab2-87eb-45b6-a0d4-64d089aa1ed5 req-7c477c5a-687a-4e45-bff7-b06cd8233fce service nova] Releasing lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "64941039-6df2-4347-8cef-ec06da35b564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:38 user nova-compute[75235]: INFO nova.compute.manager [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Terminating instance
Nov 29 19:34:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-391aee21-d9fb-4323-9934-67f6c00657b1 req-3191f6f9-8d5d-48ca-a59d-a11b18be2458 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-vif-unplugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-391aee21-d9fb-4323-9934-67f6c00657b1 req-3191f6f9-8d5d-48ca-a59d-a11b18be2458 service nova] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-391aee21-d9fb-4323-9934-67f6c00657b1 req-3191f6f9-8d5d-48ca-a59d-a11b18be2458 service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-391aee21-d9fb-4323-9934-67f6c00657b1 req-3191f6f9-8d5d-48ca-a59d-a11b18be2458 service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-391aee21-d9fb-4323-9934-67f6c00657b1 req-3191f6f9-8d5d-48ca-a59d-a11b18be2458 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] No waiting events found dispatching network-vif-unplugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-391aee21-d9fb-4323-9934-67f6c00657b1 req-3191f6f9-8d5d-48ca-a59d-a11b18be2458 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-vif-unplugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:34:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Instance destroyed successfully.
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'resources' on Instance uuid 64941039-6df2-4347-8cef-ec06da35b564 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2071810289',display_name='tempest-TestVolumeBootPattern-server-2071810289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2071810289',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:32:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-kfpn82ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:32:59Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=64941039-6df2-4347-8cef-ec06da35b564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_vif [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad3611d6-53, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca9f5fbd-1cf0-49c1-abce-b2ce4ae4e81b) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:39 user nova-compute[75235]: INFO os_vif [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:05:24,bridge_name='br-int',has_traffic_filtering=True,id=ad3611d6-531e-4f50-97d4-3b80a844bca7,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad3611d6-53')
Nov 29 19:34:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nKDbgzRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:34:39 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f2c5c6-7381-4ce0-a19c-acf968ec0c12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:34:39 user nova-compute[75235]: No targets found.
Nov 29 19:34:39 user nova-compute[75235]: iSNS:
Nov 29 19:34:39 user nova-compute[75235]: No targets found.
Nov 29 19:34:39 user nova-compute[75235]: STATIC:
Nov 29 19:34:39 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4
Nov 29 19:34:39 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:34:39 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:34:39 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:34:39 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:34:39 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:34:39 user nova-compute[75235]: FIRMWARE:
Nov 29 19:34:39 user nova-compute[75235]: No targets found.
Nov 29 19:34:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:34:39 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:34:39 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018a0df-7cb0-4358-82f3-11a0b2a59f3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9efce-2d5f-404c-97e2-e51aecc9f27f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:39 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:34:39 user nova-compute[75235]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 (non-flash)
Nov 29 19:34:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c74ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafcfc6b-a668-48d9-a824-a08f696394b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b697e-e2a9-4f4f-91c8-51bc512bcdbd]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6aab79-4571-487b-bc51-d44885ffc12a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fffd2e-7485-448b-bb7d-2efde788ee9b]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1d59ac76', '/dev/disk/by-id/scsi-23163343566366435', '/dev/disk/by-id/scsi-1SCST_BIO1d59ac76-1c45f6d56a86dc26') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:34:39 user nova-compute[75235]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1d59ac76
Nov 29 19:34:39 user nova-compute[75235]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23163343566366435
Nov 29 19:34:39 user nova-compute[75235]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1d59ac76-1c45f6d56a86dc26
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9141894-1f3c-4c31-88ee-1214ead30a96]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9d2d2-0479-449f-8432-471165332a56]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3155b158-6e4c-49fa-832b-5391db8c8ff5]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260]
Nov 29 19:34:39 user nova-compute[75235]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4, portal: 172.16.0.220,3260] successful.
Nov 29 19:34:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9d46d1-41c3-4695-a290-3012ebd756a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e35a2-c390-4c75-aba5-35474edc584d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== disconnect_volume: return (294ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:34:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Deleting instance files /opt/stack/data/nova/instances/64941039-6df2-4347-8cef-ec06da35b564_del
Nov 29 19:34:40 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Deletion of /opt/stack/data/nova/instances/64941039-6df2-4347-8cef-ec06da35b564_del complete
Nov 29 19:34:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:40 user nova-compute[75235]: INFO nova.compute.manager [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 19:34:40 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 64941039-6df2-4347-8cef-ec06da35b564] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-changed-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Refreshing instance network info cache due to event network-changed-ad3611d6-531e-4f50-97d4-3b80a844bca7. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] Acquiring lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] Acquired lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.network.neutron [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Refreshing network info cache for port ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:40 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Took 0.48 seconds to deallocate network for instance.
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-00dfce39-23d0-4ae9-9902-ad0712770a6d req-38cafd85-f9de-4f13-9f26-dfbf8a0a11be service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-vif-deleted-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:40 user nova-compute[75235]: INFO nova.compute.manager [req-00dfce39-23d0-4ae9-9902-ad0712770a6d req-38cafd85-f9de-4f13-9f26-dfbf8a0a11be service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Neutron deleted interface ad3611d6-531e-4f50-97d4-3b80a844bca7; detaching it from the instance and deleting it from the info cache
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.network.neutron [req-00dfce39-23d0-4ae9-9902-ad0712770a6d req-38cafd85-f9de-4f13-9f26-dfbf8a0a11be service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-00dfce39-23d0-4ae9-9902-ad0712770a6d req-38cafd85-f9de-4f13-9f26-dfbf8a0a11be service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Detach interface failed, port_id=ad3611d6-531e-4f50-97d4-3b80a844bca7, reason: Instance 64941039-6df2-4347-8cef-ec06da35b564 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.network.neutron [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updated VIF entry in instance network info cache for port ad3611d6-531e-4f50-97d4-3b80a844bca7. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG nova.network.neutron [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Updating instance_info_cache with network_info: [{"id": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "address": "fa:16:3e:a8:05:24", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad3611d6-53", "ovs_interfaceid": "ad3611d6-531e-4f50-97d4-3b80a844bca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:34:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-42105231-333f-44bf-be81-55551ed5b309 req-71b93f0d-00d4-4437-a442-77bbc5fe65b4 service nova] Releasing lock "refresh_cache-64941039-6df2-4347-8cef-ec06da35b564" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:34:41 user nova-compute[75235]: INFO nova.compute.manager [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-b4a1aae7-bf35-40ce-b705-1308d5a34c47 req-9feaccb2-5be2-40b4-91fd-75d0fdbf22ab service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received event network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b4a1aae7-bf35-40ce-b705-1308d5a34c47 req-9feaccb2-5be2-40b4-91fd-75d0fdbf22ab service nova] Acquiring lock "64941039-6df2-4347-8cef-ec06da35b564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b4a1aae7-bf35-40ce-b705-1308d5a34c47 req-9feaccb2-5be2-40b4-91fd-75d0fdbf22ab service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b4a1aae7-bf35-40ce-b705-1308d5a34c47 req-9feaccb2-5be2-40b4-91fd-75d0fdbf22ab service nova] Lock "64941039-6df2-4347-8cef-ec06da35b564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG nova.compute.manager [req-b4a1aae7-bf35-40ce-b705-1308d5a34c47 req-9feaccb2-5be2-40b4-91fd-75d0fdbf22ab service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] No waiting events found dispatching network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:34:41 user nova-compute[75235]: WARNING nova.compute.manager [req-b4a1aae7-bf35-40ce-b705-1308d5a34c47 req-9feaccb2-5be2-40b4-91fd-75d0fdbf22ab service nova] [instance: 64941039-6df2-4347-8cef-ec06da35b564] Received unexpected event network-vif-plugged-ad3611d6-531e-4f50-97d4-3b80a844bca7 for instance with vm_state deleted and task_state None.
Nov 29 19:34:41 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:41 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Deleted allocations for instance 64941039-6df2-4347-8cef-ec06da35b564
Nov 29 19:34:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-cf7c5e64-bd0b-45da-8d64-af7e58af4715 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "64941039-6df2-4347-8cef-ec06da35b564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:34:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:34:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:34:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:35:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:18 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75235) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:35:20 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:35:20 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.072704315185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 1781069c-646e-439c-a4b6-583e11a56b50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 663ab537-b6c8-4465-a0b7-8c83de1bbe34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:35:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:22 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:22 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:24 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:35:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:35:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:35:24 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:35:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:25 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:35:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:35:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:35:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:35 user nova-compute[75235]: INFO nova.compute.manager [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Terminating instance
Nov 29 19:35:35 user nova-compute[75235]: DEBUG nova.compute.manager [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-e8e17a1c-4bc4-4d4b-9ac2-32dcad7fc940 req-d34aa916-20d9-4346-8489-5cfb75becd04 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-unplugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e8e17a1c-4bc4-4d4b-9ac2-32dcad7fc940 req-d34aa916-20d9-4346-8489-5cfb75becd04 service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e8e17a1c-4bc4-4d4b-9ac2-32dcad7fc940 req-d34aa916-20d9-4346-8489-5cfb75becd04 service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-e8e17a1c-4bc4-4d4b-9ac2-32dcad7fc940 req-d34aa916-20d9-4346-8489-5cfb75becd04 service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-e8e17a1c-4bc4-4d4b-9ac2-32dcad7fc940 req-d34aa916-20d9-4346-8489-5cfb75becd04 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-unplugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:35 user nova-compute[75235]: DEBUG nova.compute.manager [req-e8e17a1c-4bc4-4d4b-9ac2-32dcad7fc940 req-d34aa916-20d9-4346-8489-5cfb75becd04 service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-unplugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Instance destroyed successfully.
Nov 29 19:35:36 user nova-compute[75235]: DEBUG nova.objects.instance [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lazy-loading 'resources' on Instance uuid 1781069c-646e-439c-a4b6-583e11a56b50 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:28:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1465187311',display_name='tempest-SnapshotDataIntegrityTests-server-1465187311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1465187311',id=47,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7cGyiyNKxiQMbSv/W37pEl/KvUyc8b7ng6GL6wpaeRY5rqEr7TDIIXwiL2D4kK9dJ3jVSCE2mYDVi9tOQY15+m2OzyvnNQto8o0Ez0iWKZ3yCP3c3hMkBFqsOZ+nQidw==',key_name='tempest-keypair-2082130585',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a50bf29a3f347469ff3882b7e838ebb',ramdisk_id='',reservation_id='r-ss5nkjqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-583910208',owner_user_name='tempest-SnapshotDataIntegrityTests-583910208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='134c6c3f87274be199bd0b8ceca00d5f',uuid=1781069c-646e-439c-a4b6-583e11a56b50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Converting VIF {"id": "03dc0728-2b84-4329-86a3-5ba3313242ac", "address": "fa:16:3e:58:22:e3", "network": {"id": "f1de272c-4ce7-4272-8cb7-0bcd68c3c74f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1720410273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a50bf29a3f347469ff3882b7e838ebb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03dc0728-2b", "ovs_interfaceid": "03dc0728-2b84-4329-86a3-5ba3313242ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG os_vif [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03dc0728-2b, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6dcc33a-81e5-42d4-98be-c752814b5853) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:36 user nova-compute[75235]: INFO os_vif [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=03dc0728-2b84-4329-86a3-5ba3313242ac,network=Network(f1de272c-4ce7-4272-8cb7-0bcd68c3c74f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03dc0728-2b')
Nov 29 19:35:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Deleting instance files /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50_del
Nov 29 19:35:36 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Deletion of /opt/stack/data/nova/instances/1781069c-646e-439c-a4b6-583e11a56b50_del complete
Nov 29 19:35:36 user nova-compute[75235]: INFO nova.compute.manager [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 19:35:36 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:35:36 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-14514097-75df-4fd6-af88-16cbfe244c75 req-20c7b7c2-3d76-4ef9-9c79-05a6c65bc53e service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-deleted-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:37 user nova-compute[75235]: INFO nova.compute.manager [req-14514097-75df-4fd6-af88-16cbfe244c75 req-20c7b7c2-3d76-4ef9-9c79-05a6c65bc53e service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Neutron deleted interface 03dc0728-2b84-4329-86a3-5ba3313242ac; detaching it from the instance and deleting it from the info cache
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.network.neutron [req-14514097-75df-4fd6-af88-16cbfe244c75 req-20c7b7c2-3d76-4ef9-9c79-05a6c65bc53e service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:35:37 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Took 1.01 seconds to deallocate network for instance.
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-14514097-75df-4fd6-af88-16cbfe244c75 req-20c7b7c2-3d76-4ef9-9c79-05a6c65bc53e service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Detach interface failed, port_id=03dc0728-2b84-4329-86a3-5ba3313242ac, reason: Instance 1781069c-646e-439c-a4b6-583e11a56b50 could not be found. {{(pid=75235) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Deleted allocations for instance 1781069c-646e-439c-a4b6-583e11a56b50
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-edb112a4-a172-4379-b171-7c395e6f029e tempest-SnapshotDataIntegrityTests-583910208 tempest-SnapshotDataIntegrityTests-583910208-project-member] Lock "1781069c-646e-439c-a4b6-583e11a56b50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:37 user nova-compute[75235]: WARNING nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state deleted and task_state None.
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:37 user nova-compute[75235]: WARNING nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state deleted and task_state None.
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:37 user nova-compute[75235]: WARNING nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state deleted and task_state None.
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-unplugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-unplugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:37 user nova-compute[75235]: WARNING nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-unplugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state deleted and task_state None.
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Acquiring lock "1781069c-646e-439c-a4b6-583e11a56b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] Lock "1781069c-646e-439c-a4b6-583e11a56b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:37 user nova-compute[75235]: DEBUG nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] No waiting events found dispatching network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:37 user nova-compute[75235]: WARNING nova.compute.manager [req-58724877-29a8-4556-9407-6b1589dca574 req-ee92eb83-9c25-47d2-9add-334d1a94506c service nova] [instance: 1781069c-646e-439c-a4b6-583e11a56b50] Received unexpected event network-vif-plugged-03dc0728-2b84-4329-86a3-5ba3313242ac for instance with vm_state deleted and task_state None.
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:38 user nova-compute[75235]: INFO nova.compute.manager [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Terminating instance
Nov 29 19:35:38 user nova-compute[75235]: DEBUG nova.compute.manager [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-0a42fd79-50c6-4efe-9d4c-898137a34261 req-cd9f0685-1fe5-4957-a52e-0579266488ac service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-vif-unplugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0a42fd79-50c6-4efe-9d4c-898137a34261 req-cd9f0685-1fe5-4957-a52e-0579266488ac service nova] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0a42fd79-50c6-4efe-9d4c-898137a34261 req-cd9f0685-1fe5-4957-a52e-0579266488ac service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-0a42fd79-50c6-4efe-9d4c-898137a34261 req-cd9f0685-1fe5-4957-a52e-0579266488ac service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-0a42fd79-50c6-4efe-9d4c-898137a34261 req-cd9f0685-1fe5-4957-a52e-0579266488ac service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] No waiting events found dispatching network-vif-unplugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:38 user nova-compute[75235]: DEBUG nova.compute.manager [req-0a42fd79-50c6-4efe-9d4c-898137a34261 req-cd9f0685-1fe5-4957-a52e-0579266488ac service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-vif-unplugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:35:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Instance destroyed successfully.
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.objects.instance [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lazy-loading 'resources' on Instance uuid 663ab537-b6c8-4465-a0b7-8c83de1bbe34 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1537076786',display_name='tempest-TestVolumeBootPattern-server-1537076786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1537076786',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgx5kbLy6krGzgN8NwsC2CrbJkdExFMPIbK1HNJ2rJ/dDOchPJK4dJf/eeQ/Er8eRaONRA+CaLO4E3OXo6KzjVAmgHcacaReUsVUsGJ6YHhKFVDbQ2z8aZNpuwPBi6tMg==',key_name='tempest-TestVolumeBootPattern-1736792583',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87e15c428b2f43b9a2e5850370c4f938',ramdisk_id='',reservation_id='r-rwhm0wdn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-656128499',owner_user_name='tempest-TestVolumeBootPattern-656128499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:30:58Z,user_data=None,user_id='f20d52323a014526b5ebd121d637f4c4',uuid=663ab537-b6c8-4465-a0b7-8c83de1bbe34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converting VIF {"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_vif [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafab173b-1d, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7504511-2181-4837-b456-c8c98d2035a2) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:39 user nova-compute[75235]: INFO os_vif [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:34:76,bridge_name='br-int',has_traffic_filtering=True,id=afab173b-1dda-4e85-8a9c-127b0ab40a57,network=Network(d82c5db0-7abe-4cfc-93de-7a7ef47e67e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafab173b-1d')
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRGulkqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:35:39 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b918cc5f-fe5a-43a1-aef0-52a4561cac1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:35:39 user nova-compute[75235]: No targets found.
Nov 29 19:35:39 user nova-compute[75235]: iSNS:
Nov 29 19:35:39 user nova-compute[75235]: No targets found.
Nov 29 19:35:39 user nova-compute[75235]: STATIC:
Nov 29 19:35:39 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b
Nov 29 19:35:39 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:35:39 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:35:39 user nova-compute[75235]: FIRMWARE:
Nov 29 19:35:39 user nova-compute[75235]: No targets found.
Nov 29 19:35:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:35:39 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:35:39 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81e5a6-7583-45e9-8941-d1f7a310b811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e7f08-1c37-4aae-b318-4b935d532cc0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:35:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b (non-flash)
Nov 29 19:35:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c5f31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b'): ({'sdd'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Removing single pathed devices sdd {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58bafce-e821-4296-bce9-83f74f23838c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cfcb98-2254-4f68-b853-64bbcb98c2ad]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Flushing IO for device /dev/sdd {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6e20b9-6144-449a-9a40-7901216c992a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aa9dbc-eaaa-4fb9-93e4-a3be81cd8fe9]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] SCSI volumes sdd have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_eff9b271', '/dev/disk/by-id/scsi-1SCST_BIOeff9b271-b0c30a10a8b7711d', '/dev/disk/by-id/scsi-26230633330613130') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78027d9-8100-4f26-a193-2f7fe325df21]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff849bb1-77cc-4879-9cb6-1a46652f66b9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[14259ec4-594a-4c31-a604-0ce6e2692350]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260]
Nov 29 19:35:39 user nova-compute[75235]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b, portal: 172.16.0.220,3260] successful.
Nov 29 19:35:39 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-changed-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.compute.manager [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Refreshing instance network info cache due to event network-changed-afab173b-1dda-4e85-8a9c-127b0ab40a57. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] Acquiring lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] Acquired lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Refreshing network info cache for port afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a8fa9e2-a5a6-4b8f-ab16-39722c450c8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[02229793-844a-4b13-b719-5b0c737c808e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] <== disconnect_volume: return (302ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:35:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Deleting instance files /opt/stack/data/nova/instances/663ab537-b6c8-4465-a0b7-8c83de1bbe34_del
Nov 29 19:35:39 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Deletion of /opt/stack/data/nova/instances/663ab537-b6c8-4465-a0b7-8c83de1bbe34_del complete
Nov 29 19:35:39 user nova-compute[75235]: INFO nova.compute.manager [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updated VIF entry in instance network info cache for port afab173b-1dda-4e85-8a9c-127b0ab40a57. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG nova.network.neutron [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [{"id": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "address": "fa:16:3e:7d:34:76", "network": {"id": "d82c5db0-7abe-4cfc-93de-7a7ef47e67e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-538408245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87e15c428b2f43b9a2e5850370c4f938", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafab173b-1d", "ovs_interfaceid": "afab173b-1dda-4e85-8a9c-127b0ab40a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:35:39 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-61f8e8bb-b445-4984-98a0-7089ba26338f req-a9644900-6133-449c-9d64-5d2b72e9786e service nova] Releasing lock "refresh_cache-663ab537-b6c8-4465-a0b7-8c83de1bbe34" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:35:40 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:35:40 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Took 0.51 seconds to deallocate network for instance.
Nov 29 19:35:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-5d866288-1f3a-4a3e-b473-83ee45358cab req-017f6e03-c464-4056-adaa-a4ebf592f22a service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-vif-deleted-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-b4c0cc96-c2d7-48a3-9856-20e139779e48 req-a0cfee8f-15bb-4abf-9d18-0c8edfe58bb8 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received event network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b4c0cc96-c2d7-48a3-9856-20e139779e48 req-a0cfee8f-15bb-4abf-9d18-0c8edfe58bb8 service nova] Acquiring lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b4c0cc96-c2d7-48a3-9856-20e139779e48 req-a0cfee8f-15bb-4abf-9d18-0c8edfe58bb8 service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:40 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-b4c0cc96-c2d7-48a3-9856-20e139779e48 req-a0cfee8f-15bb-4abf-9d18-0c8edfe58bb8 service nova] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:40 user nova-compute[75235]: DEBUG nova.compute.manager [req-b4c0cc96-c2d7-48a3-9856-20e139779e48 req-a0cfee8f-15bb-4abf-9d18-0c8edfe58bb8 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] No waiting events found dispatching network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:35:40 user nova-compute[75235]: WARNING nova.compute.manager [req-b4c0cc96-c2d7-48a3-9856-20e139779e48 req-a0cfee8f-15bb-4abf-9d18-0c8edfe58bb8 service nova] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Received unexpected event network-vif-plugged-afab173b-1dda-4e85-8a9c-127b0ab40a57 for instance with vm_state active and task_state deleting.
Nov 29 19:35:41 user nova-compute[75235]: INFO nova.compute.manager [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] [instance: 663ab537-b6c8-4465-a0b7-8c83de1bbe34] Took 0.95 seconds to detach 1 volumes for instance.
Nov 29 19:35:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:35:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:35:41 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:35:41 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:35:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:41 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Deleted allocations for instance 663ab537-b6c8-4465-a0b7-8c83de1bbe34
Nov 29 19:35:41 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-4059ad28-f566-43e6-8df7-686641b58036 tempest-TestVolumeBootPattern-656128499 tempest-TestVolumeBootPattern-656128499-project-member] Lock "663ab537-b6c8-4465-a0b7-8c83de1bbe34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:35:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:35:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:35:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-changed-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Refreshing instance network info cache due to event network-changed-ad0831bf-3799-45b7-ad65-1b313c2b35b0. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] Acquiring lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] Acquired lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Refreshing network info cache for port ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updated VIF entry in instance network info cache for port ad0831bf-3799-45b7-ad65-1b313c2b35b0. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updating instance_info_cache with network_info: [{"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:35:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-82ccf0ee-f132-4095-8128-6d0ea75cd127 req-3364e7db-26ac-4887-9b02-9ef4dbe3ae86 service nova] Releasing lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:35:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:35:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:35:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:35:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:00 user nova-compute[75235]: INFO nova.compute.manager [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Attaching volume 14e97126-2746-4bec-a1c0-f13b607c5b12 to /dev/vdb
Nov 29 19:36:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42d3929-12f2-4307-bb78-5cd5c7699298]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[608be493-6885-4b96-8d39-d7c71cd007cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf48d61-073b-4b6c-86c8-34561b271cfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e0f226-4bcb-42ec-83c6-4fb7c1a0d583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:36:00 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:36:00 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[546350b4-79f2-4349-80df-d7b7933eaa1b]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG os_brick.utils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:36:00 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updating existing volume attachment record: a6043240-8f09-482b-bc2a-bc421841de14 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:36:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luFSkCdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:36:07 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:36:07 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:36:07 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f9d062-cc4e-4a40-8ef0-370116a23e45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:36:07 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ac7d7-0786-4593-b5ce-94e4d550c507]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12] added
Nov 29 19:36:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[de77e0cb-8e32-481c-827e-83127f5a202c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa54a4-b230-4376-abff-7bd67f45342b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luFSkCdy {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v luFSkCdy" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a157f254-79c6-4d77-8129-e03a081322c4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'luFSkCdy'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a05d61b-81a3-4eaf-9740-6831b38dd734]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ba644-22c8-4a63-b3b6-bc5775dea33d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:36:07 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:36:07 user nova-compute[75235]:  {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:36:07 user nova-compute[75235]: WARNING os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 19:36:07 user nova-compute[75235]: 
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2f551-07bf-429a-9e0c-34f97e40c1a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260]
Nov 29 19:36:07 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260] successful.
Nov 29 19:36:07 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:07 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[71731897-ff75-46d2-8f79-b773cc2dc122]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[45985ebe-e1ef-48c6-b53c-e213a08e1013]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 (non-flash)
Nov 29 19:36:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 (non-flash)
Nov 29 19:36:08 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa1b5ff-17b8-4f08-81c0-0a3623658678]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:36:08 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luFSkCdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26539633563373230', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539633563373230', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG nova.objects.instance [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:36:09 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:36:09 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:36:09 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:36:09 user nova-compute[75235]:   <serial>14e97126-2746-4bec-a1c0-f13b607c5b12</serial>
Nov 29 19:36:09 user nova-compute[75235]: </disk>
Nov 29 19:36:09 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:62:16:0a, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:36:09 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-3a6aed82-b5e5-415f-a5d2-bdf9edf45d8b tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.165s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:10 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:10 user nova-compute[75235]: INFO nova.compute.manager [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Detaching volume 14e97126-2746-4bec-a1c0-f13b607c5b12
Nov 29 19:36:10 user nova-compute[75235]: INFO nova.virt.block_device [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Attempting to driver detach volume 14e97126-2746-4bec-a1c0-f13b607c5b12 from mountpoint /dev/vdb
Nov 29 19:36:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Attempting to detach device vdb from instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:36:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:36:10 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:36:10 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:36:10 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:36:10 user nova-compute[75235]:   <serial>14e97126-2746-4bec-a1c0-f13b607c5b12</serial>
Nov 29 19:36:10 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:36:10 user nova-compute[75235]: </disk>
Nov 29 19:36:10 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:36:10 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully detached device vdb from instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 from the persistent domain config.
Nov 29 19:36:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:36:10 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:36:10 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:36:10 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:36:10 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:36:10 user nova-compute[75235]:   <serial>14e97126-2746-4bec-a1c0-f13b607c5b12</serial>
Nov 29 19:36:10 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:36:10 user nova-compute[75235]: </disk>
Nov 29 19:36:10 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:36:11 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:36:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:20 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:20 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:20 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:21 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:36:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.09912872314453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:36:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:36:24 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:26 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:36:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:36:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:36:26 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:36:26 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:27 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updating instance_info_cache with network_info: [{"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:36:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-4b7afeb1-3e44-4489-a3a8-09d6304d64d3" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:36:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:36:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:31 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 is timed out.
Nov 29 19:36:31 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully detached device vdb from instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 from the live domain config.
Nov 29 19:36:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'luFSkCdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:36:31 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba5f4c-b825-43c0-ba1c-bba2fe749d49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:36:31 user nova-compute[75235]: No targets found.
Nov 29 19:36:31 user nova-compute[75235]: iSNS:
Nov 29 19:36:31 user nova-compute[75235]: No targets found.
Nov 29 19:36:31 user nova-compute[75235]: STATIC:
Nov 29 19:36:31 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12
Nov 29 19:36:31 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:36:31 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:36:31 user nova-compute[75235]: FIRMWARE:
Nov 29 19:36:31 user nova-compute[75235]: No targets found.
Nov 29 19:36:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:36:31 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:36:31 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c97f75-2919-465a-9dc2-fdc65b75bee4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1adc0e8-df17-415c-86bf-a62c731c4abb]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 (non-flash)
Nov 29 19:36:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 (non-flash)
Nov 29 19:36:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f562c708940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e6034c-6a5a-4b4d-ae34-a188e0a5190c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981e2d7-8fdd-4636-9c3b-cebac31a93d0]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c08a46-a21a-4b7f-a4bf-2fdb3cb1650a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa10eb8-3661-4f9b-bd3a-0a94aacd1ebf]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff6c54e-7565-4c99-9661-884163cd1745]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae83af8-2a71-4827-94ee-036e38dc5e65]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260]
Nov 29 19:36:31 user nova-compute[75235]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12, portal: 172.16.0.220,3260] successful.
Nov 29 19:36:31 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e97126-2746-4bec-a1c0-f13b607c5b12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b0448d-30ef-4eae-bf56-ac2f57a454c6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== disconnect_volume: return (297ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:36:31 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:36:32 user nova-compute[75235]: DEBUG nova.objects.instance [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:36:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-d9536dce-9e18-4670-8ca8-82df44b28b14 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.643s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:33 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:40 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Verify base images {{(pid=75235) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Image id 2df0cf47-6e1a-495b-92f5-27a94d1b3217 yields fingerprint 765786f8832c45d39374fad8a8ef5539a85e61a0 {{(pid=75235) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] image 2df0cf47-6e1a-495b-92f5-27a94d1b3217 at (/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0): checking
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] image 2df0cf47-6e1a-495b-92f5-27a94d1b3217 at (/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0): image is in use {{(pid=75235) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75235) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 is a valid instance name {{(pid=75235) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 has a disk file {{(pid=75235) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 is backed by 765786f8832c45d39374fad8a8ef5539a85e61a0 {{(pid=75235) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c
Nov 29 19:36:44 user nova-compute[75235]: WARNING nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Active base files: /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Removable base files: /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893 /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9 /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930 /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20 /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08 /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1 /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/80da39ae67771b2e4e9f379d33592ce89cf83893
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/449af33248b935cbeedfc38b77d43789e69f09d9
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/77a38ec1523d86b82cf850df3195c0ebb4473add
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8dce12b2f2859ed84f3a4b7165cc3d9a12686930
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/78f97d2a18946cdb7ead3aae63c34d0a90aa7a20
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82ad7dbdf54d1f9dcb60c1006953c157d5f45e08
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3e5228e15ce9152065bf1c961a82538ceadecb1
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c9d77524699cc3b822e0c192bd4d0bf8cdb900c
Nov 29 19:36:44 user nova-compute[75235]: INFO nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d32a0bb2c868e7899e4205167ff4dee6b2bfe519
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Verification complete {{(pid=75235) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Verify swap images {{(pid=75235) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 19:36:44 user nova-compute[75235]: DEBUG nova.virt.libvirt.imagecache [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Verify ephemeral images {{(pid=75235) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 19:36:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:36:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:36:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:00 user nova-compute[75235]: INFO nova.compute.manager [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Terminating instance
Nov 29 19:37:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-a720c149-81d7-4db9-a33c-874791a970e9 req-4de45dd6-f6dd-4145-93e7-3b47551d88c3 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-unplugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a720c149-81d7-4db9-a33c-874791a970e9 req-4de45dd6-f6dd-4145-93e7-3b47551d88c3 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a720c149-81d7-4db9-a33c-874791a970e9 req-4de45dd6-f6dd-4145-93e7-3b47551d88c3 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a720c149-81d7-4db9-a33c-874791a970e9 req-4de45dd6-f6dd-4145-93e7-3b47551d88c3 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-a720c149-81d7-4db9-a33c-874791a970e9 req-4de45dd6-f6dd-4145-93e7-3b47551d88c3 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-unplugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.compute.manager [req-a720c149-81d7-4db9-a33c-874791a970e9 req-4de45dd6-f6dd-4145-93e7-3b47551d88c3 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-unplugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Instance destroyed successfully.
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.objects.instance [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'resources' on Instance uuid 4b7afeb1-3e44-4489-a3a8-09d6304d64d3 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:34:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1386282348',display_name='tempest-AttachVolumeNegativeTest-server-1386282348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1386282348',id=51,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2X6C/qixrPnJm7B5Y+qqjBGmgWxhFXHV8pyQZz/+VPgPkg4TLKzXWV+Sqg5FrN8XllfuIGj+ocqc5c74JEKW4JaDcSdL4i8rVqxNvsyXBXT73DIGgOWEWs+7pTOFrrzw==',key_name='tempest-keypair-1772602022',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:34:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-hnfrlvmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=4b7afeb1-3e44-4489-a3a8-09d6304d64d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "address": "fa:16:3e:62:16:0a", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0831bf-37", "ovs_interfaceid": "ad0831bf-3799-45b7-ad65-1b313c2b35b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG os_vif [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad0831bf-37, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17432d9e-03b8-4461-bec2-625b7f04e551) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:01 user nova-compute[75235]: INFO os_vif [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:16:0a,bridge_name='br-int',has_traffic_filtering=True,id=ad0831bf-3799-45b7-ad65-1b313c2b35b0,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0831bf-37')
Nov 29 19:37:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Deleting instance files /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3_del
Nov 29 19:37:01 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Deletion of /opt/stack/data/nova/instances/4b7afeb1-3e44-4489-a3a8-09d6304d64d3_del complete
Nov 29 19:37:01 user nova-compute[75235]: INFO nova.compute.manager [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 29 19:37:01 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:37:01 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:37:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:03 user nova-compute[75235]: WARNING nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received unexpected event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with vm_state active and task_state deleting.
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:03 user nova-compute[75235]: WARNING nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received unexpected event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with vm_state active and task_state deleting.
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:03 user nova-compute[75235]: WARNING nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received unexpected event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with vm_state active and task_state deleting.
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-unplugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-unplugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.manager [req-c6a0d5d6-e5e4-401f-afe4-69398cddd0b1 req-f534764b-ef84-479c-a120-a0c881c27b34 service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-unplugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:37:03 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Took 1.62 seconds to deallocate network for instance.
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:03 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Deleted allocations for instance 4b7afeb1-3e44-4489-a3a8-09d6304d64d3
Nov 29 19:37:03 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-87f14319-9d2d-46b3-a2f6-fa4d1be2066d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] Acquiring lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:05 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] Lock "4b7afeb1-3e44-4489-a3a8-09d6304d64d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] No waiting events found dispatching network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:05 user nova-compute[75235]: WARNING nova.compute.manager [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received unexpected event network-vif-plugged-ad0831bf-3799-45b7-ad65-1b313c2b35b0 for instance with vm_state deleted and task_state None.
Nov 29 19:37:05 user nova-compute[75235]: DEBUG nova.compute.manager [req-f3f421d8-68b1-4692-b4a7-f85334060d2e req-75fac3c2-ea0a-4609-8e26-b207b5a8e2ba service nova] [instance: 4b7afeb1-3e44-4489-a3a8-09d6304d64d3] Received event network-vif-deleted-ad0831bf-3799-45b7-ad65-1b313c2b35b0 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:06 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:11 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:16 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:37:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:21 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:21 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:37:22 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:37:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=25.123889923095703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:37:22 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:37:24 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:26 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:37:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:37:27 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:37:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:35 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:40 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:37:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:37:45 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:37:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:51 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Starting instance... {{(pid=75235) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75235) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 19:37:55 user nova-compute[75235]: INFO nova.compute.claims [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Claim successful on node user
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Refreshing inventories for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Updating ProviderTree inventory for provider 5d984797-93a3-43d0-9a35-bb500b1e869a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Updating inventory in ProviderTree for provider 5d984797-93a3-43d0-9a35-bb500b1e869a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Refreshing aggregate associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, aggregates: None {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Refreshing trait associations for resource provider 5d984797-93a3-43d0-9a35-bb500b1e869a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75235) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Start building networks asynchronously for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Allocating IP information in the background. {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] allocate_for_instance() {{(pid=75235) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 19:37:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Start building block device mappings for instance. {{(pid=75235) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.policy [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c44ac18976b4232a45bedacf9177023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2594a91424a6408a9c6c57d5364bc9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75235) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Start spawning the instance on the hypervisor. {{(pid=75235) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Creating instance directory {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 19:37:55 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Creating image(s)
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "/opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "/opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.168s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "765786f8832c45d39374fad8a8ef5539a85e61a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.183s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk 1073741824 {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0,backing_fmt=raw /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk 1073741824" returned: 0 in 0.050s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "765786f8832c45d39374fad8a8ef5539a85e61a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Successfully created port: f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765786f8832c45d39374fad8a8ef5539a85e61a0 --force-share --output=json" returned: 0 in 0.185s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk. size=1073741824 {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG nova.virt.disk.api [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Cannot resize image /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk to a smaller size. {{(pid=75235) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Created local disks {{(pid=75235) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Ensure instance console log exists: /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/console.log {{(pid=75235) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:56 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Successfully updated port: f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquired lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Building network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-changed-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.compute.manager [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Refreshing instance network info cache due to event network-changed-f12df099-5d7b-4c36-94ad-18005138cff3. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] Acquiring lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Instance cache missing network info. {{(pid=75235) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.neutron [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Releasing lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Instance network_info: |[{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75235) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] Acquired lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Refreshing network info cache for port f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Start _get_guest_xml network_info=[{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'size': 0, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '2df0cf47-6e1a-495b-92f5-27a94d1b3217'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 19:37:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:37:57 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller missing on host. {{(pid=75235) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.host [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU controller found on host. {{(pid=75235) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75235) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T18:57:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T18:57:13Z,direct_url=<?>,disk_format='qcow2',id=2df0cf47-6e1a-495b-92f5-27a94d1b3217,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='80b3352fffc44fa490721284ad4b9758',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T18:57:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image limits 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flavor pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Image pref 0:0:0 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75235) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Got 1 possible topologies {{(pid=75235) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.hardware [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75235) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-540761815',display_name='tempest-AttachVolumeNegativeTest-server-540761815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-540761815',id=52,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/rL7Jd6wI697nQgymzVMz4JK/JnnxG/vaE0zf0TzmNHmUOt/FE9w7OBZ4mmBXxFRvDrffuUzMwSWzimSBxJWYAiP5aMS8FlVaWrHCGRrWX7AjVLvrq47D89xQJ6i4HnA==',key_name='tempest-keypair-396601116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-1zlhj06q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:37:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=05b2fbb1-7292-431c-b2a3-041b4d43bc00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75235) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.objects.instance [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'pci_devices' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] End _get_guest_xml xml=<domain type="kvm">
Nov 29 19:37:57 user nova-compute[75235]:   <uuid>05b2fbb1-7292-431c-b2a3-041b4d43bc00</uuid>
Nov 29 19:37:57 user nova-compute[75235]:   <name>instance-00000034</name>
Nov 29 19:37:57 user nova-compute[75235]:   <memory>524288</memory>
Nov 29 19:37:57 user nova-compute[75235]:   <vcpu>1</vcpu>
Nov 29 19:37:57 user nova-compute[75235]:   <metadata>
Nov 29 19:37:57 user nova-compute[75235]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 19:37:57 user nova-compute[75235]:       <nova:package version="0.0.0"/>
Nov 29 19:37:57 user nova-compute[75235]:       <nova:name>tempest-AttachVolumeNegativeTest-server-540761815</nova:name>
Nov 29 19:37:57 user nova-compute[75235]:       <nova:creationTime>2023-11-29 19:37:57</nova:creationTime>
Nov 29 19:37:57 user nova-compute[75235]:       <nova:flavor name="m1.tiny">
Nov 29 19:37:57 user nova-compute[75235]:         <nova:memory>512</nova:memory>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:disk>1</nova:disk>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:swap>0</nova:swap>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:vcpus>1</nova:vcpus>
Nov 29 19:37:57 user nova-compute[75235]:       </nova:flavor>
Nov 29 19:37:57 user nova-compute[75235]:       <nova:owner>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:user uuid="4c44ac18976b4232a45bedacf9177023">tempest-AttachVolumeNegativeTest-1078373175-project-member</nova:user>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:project uuid="2594a91424a6408a9c6c57d5364bc9bb">tempest-AttachVolumeNegativeTest-1078373175</nova:project>
Nov 29 19:37:57 user nova-compute[75235]:       </nova:owner>
Nov 29 19:37:57 user nova-compute[75235]:       <nova:root type="image" uuid="2df0cf47-6e1a-495b-92f5-27a94d1b3217"/>
Nov 29 19:37:57 user nova-compute[75235]:       <nova:ports>
Nov 29 19:37:57 user nova-compute[75235]:         <nova:port uuid="f12df099-5d7b-4c36-94ad-18005138cff3">
Nov 29 19:37:57 user nova-compute[75235]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 19:37:57 user nova-compute[75235]:         </nova:port>
Nov 29 19:37:57 user nova-compute[75235]:       </nova:ports>
Nov 29 19:37:57 user nova-compute[75235]:     </nova:instance>
Nov 29 19:37:57 user nova-compute[75235]:   </metadata>
Nov 29 19:37:57 user nova-compute[75235]:   <sysinfo type="smbios">
Nov 29 19:37:57 user nova-compute[75235]:     <system>
Nov 29 19:37:57 user nova-compute[75235]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 19:37:57 user nova-compute[75235]:       <entry name="product">OpenStack Nova</entry>
Nov 29 19:37:57 user nova-compute[75235]:       <entry name="version">0.0.0</entry>
Nov 29 19:37:57 user nova-compute[75235]:       <entry name="serial">05b2fbb1-7292-431c-b2a3-041b4d43bc00</entry>
Nov 29 19:37:57 user nova-compute[75235]:       <entry name="uuid">05b2fbb1-7292-431c-b2a3-041b4d43bc00</entry>
Nov 29 19:37:57 user nova-compute[75235]:       <entry name="family">Virtual Machine</entry>
Nov 29 19:37:57 user nova-compute[75235]:     </system>
Nov 29 19:37:57 user nova-compute[75235]:   </sysinfo>
Nov 29 19:37:57 user nova-compute[75235]:   <os>
Nov 29 19:37:57 user nova-compute[75235]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 19:37:57 user nova-compute[75235]:     <boot dev="hd"/>
Nov 29 19:37:57 user nova-compute[75235]:     <smbios mode="sysinfo"/>
Nov 29 19:37:57 user nova-compute[75235]:   </os>
Nov 29 19:37:57 user nova-compute[75235]:   <features>
Nov 29 19:37:57 user nova-compute[75235]:     <acpi/>
Nov 29 19:37:57 user nova-compute[75235]:     <apic/>
Nov 29 19:37:57 user nova-compute[75235]:     <vmcoreinfo/>
Nov 29 19:37:57 user nova-compute[75235]:   </features>
Nov 29 19:37:57 user nova-compute[75235]:   <clock offset="utc">
Nov 29 19:37:57 user nova-compute[75235]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 19:37:57 user nova-compute[75235]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 19:37:57 user nova-compute[75235]:     <timer name="hpet" present="no"/>
Nov 29 19:37:57 user nova-compute[75235]:   </clock>
Nov 29 19:37:57 user nova-compute[75235]:   <cpu mode="custom" match="exact">
Nov 29 19:37:57 user nova-compute[75235]:     <model>Nehalem</model>
Nov 29 19:37:57 user nova-compute[75235]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 19:37:57 user nova-compute[75235]:   </cpu>
Nov 29 19:37:57 user nova-compute[75235]:   <devices>
Nov 29 19:37:57 user nova-compute[75235]:     <disk type="file" device="disk">
Nov 29 19:37:57 user nova-compute[75235]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 19:37:57 user nova-compute[75235]:       <source file="/opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk"/>
Nov 29 19:37:57 user nova-compute[75235]:       <target dev="vda" bus="virtio"/>
Nov 29 19:37:57 user nova-compute[75235]:     </disk>
Nov 29 19:37:57 user nova-compute[75235]:     <interface type="ethernet">
Nov 29 19:37:57 user nova-compute[75235]:       <mac address="fa:16:3e:e5:4e:bc"/>
Nov 29 19:37:57 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:37:57 user nova-compute[75235]:       <mtu size="1442"/>
Nov 29 19:37:57 user nova-compute[75235]:       <target dev="tapf12df099-5d"/>
Nov 29 19:37:57 user nova-compute[75235]:     </interface>
Nov 29 19:37:57 user nova-compute[75235]:     <serial type="pty">
Nov 29 19:37:57 user nova-compute[75235]:       <log file="/opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/console.log" append="off"/>
Nov 29 19:37:57 user nova-compute[75235]:     </serial>
Nov 29 19:37:57 user nova-compute[75235]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 19:37:57 user nova-compute[75235]:     <video>
Nov 29 19:37:57 user nova-compute[75235]:       <model type="virtio"/>
Nov 29 19:37:57 user nova-compute[75235]:     </video>
Nov 29 19:37:57 user nova-compute[75235]:     <rng model="virtio">
Nov 29 19:37:57 user nova-compute[75235]:       <backend model="random">/dev/urandom</backend>
Nov 29 19:37:57 user nova-compute[75235]:     </rng>
Nov 29 19:37:57 user nova-compute[75235]:     <controller type="usb" index="0" model="none"/>
Nov 29 19:37:57 user nova-compute[75235]:     <memballoon model="virtio">
Nov 29 19:37:57 user nova-compute[75235]:       <stats period="10"/>
Nov 29 19:37:57 user nova-compute[75235]:     </memballoon>
Nov 29 19:37:57 user nova-compute[75235]:   </devices>
Nov 29 19:37:57 user nova-compute[75235]: </domain>
Nov 29 19:37:57 user nova-compute[75235]:  {{(pid=75235) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-540761815',display_name='tempest-AttachVolumeNegativeTest-server-540761815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-540761815',id=52,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/rL7Jd6wI697nQgymzVMz4JK/JnnxG/vaE0zf0TzmNHmUOt/FE9w7OBZ4mmBXxFRvDrffuUzMwSWzimSBxJWYAiP5aMS8FlVaWrHCGRrWX7AjVLvrq47D89xQJ6i4HnA==',key_name='tempest-keypair-396601116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-1zlhj06q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T19:37:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=05b2fbb1-7292-431c-b2a3-041b4d43bc00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG os_vif [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d') {{(pid=75235) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a03931dc-4d5c-5461-97ec-3aa175b12770', '_type': 'linux-noop'}}, row=False) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf12df099-5d, may_exist=True, interface_attrs={}) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf12df099-5d, col_values=(('qos', UUID('f9d26d17-3460-4902-bab2-451fdd2c9fd0')),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf12df099-5d, col_values=(('external_ids', {'iface-id': 'f12df099-5d7b-4c36-94ad-18005138cff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:4e:bc', 'vm-uuid': '05b2fbb1-7292-431c-b2a3-041b4d43bc00'}),), if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:57 user nova-compute[75235]: INFO os_vif [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d')
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:e5:4e:bc, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updated VIF entry in instance network info cache for port f12df099-5d7b-4c36-94ad-18005138cff3. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG nova.network.neutron [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:37:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-a1cac0ff-ef87-4e56-bbae-399bcfa4f8b0 req-0ae1e28f-b274-4a70-9a14-70257e7a88cf service nova] Releasing lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e62f778-d380-40f8-a126-138f6ae9c01c req-94ef46be-99ea-4119-9284-37c62108ba46 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e62f778-d380-40f8-a126-138f6ae9c01c req-94ef46be-99ea-4119-9284-37c62108ba46 service nova] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e62f778-d380-40f8-a126-138f6ae9c01c req-94ef46be-99ea-4119-9284-37c62108ba46 service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-7e62f778-d380-40f8-a126-138f6ae9c01c req-94ef46be-99ea-4119-9284-37c62108ba46 service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:37:58 user nova-compute[75235]: DEBUG nova.compute.manager [req-7e62f778-d380-40f8-a126-138f6ae9c01c req-94ef46be-99ea-4119-9284-37c62108ba46 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] No waiting events found dispatching network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:37:58 user nova-compute[75235]: WARNING nova.compute.manager [req-7e62f778-d380-40f8-a126-138f6ae9c01c req-94ef46be-99ea-4119-9284-37c62108ba46 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received unexpected event network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 for instance with vm_state building and task_state spawning.
Nov 29 19:37:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:37:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Instance event wait completed in 0 seconds for  {{(pid=75235) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Guest created on hypervisor {{(pid=75235) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 19:38:00 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Instance spawned successfully.
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Found default for hw_cdrom_bus of ide {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Found default for hw_disk_bus of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Found default for hw_input_bus of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Found default for hw_pointer_model of None {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Found default for hw_video_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Found default for hw_vif_model of virtio {{(pid=75235) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-30f4b82f-c9f4-48b3-a11f-f4e725a8a847 req-e61cfc71-6582-46f3-8566-d49164434183 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-30f4b82f-c9f4-48b3-a11f-f4e725a8a847 req-e61cfc71-6582-46f3-8566-d49164434183 service nova] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-30f4b82f-c9f4-48b3-a11f-f4e725a8a847 req-e61cfc71-6582-46f3-8566-d49164434183 service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-30f4b82f-c9f4-48b3-a11f-f4e725a8a847 req-e61cfc71-6582-46f3-8566-d49164434183 service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.compute.manager [req-30f4b82f-c9f4-48b3-a11f-f4e725a8a847 req-e61cfc71-6582-46f3-8566-d49164434183 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] No waiting events found dispatching network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:38:00 user nova-compute[75235]: WARNING nova.compute.manager [req-30f4b82f-c9f4-48b3-a11f-f4e725a8a847 req-e61cfc71-6582-46f3-8566-d49164434183 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received unexpected event network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 for instance with vm_state building and task_state spawning.
Nov 29 19:38:00 user nova-compute[75235]: INFO nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 29 19:38:00 user nova-compute[75235]: DEBUG nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Checking state {{(pid=75235) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 19:38:01 user nova-compute[75235]: INFO nova.compute.manager [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Took 5.97 seconds to build instance.
Nov 29 19:38:01 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-bdce062f-6c9b-4eea-8661-905025ac504d tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.068s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:38:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:38:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:38:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:15 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Triggering sync for uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 19:38:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:38:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:38:17 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:38:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:22 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:22 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:38:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:38:24 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:38:24 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=25.095508575439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:38:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:38:25 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:29 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:38:29 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:38:30 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:38:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:38:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:38:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:38:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:38:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:38:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:38:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:38:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:38:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:38:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:38:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:39:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:39:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:19 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:23 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:24 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:39:24 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=25.093551635742188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:39:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:39:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:29 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:39:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:39:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:39:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:45 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:39:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-changed-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:39:45 user nova-compute[75235]: DEBUG nova.compute.manager [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Refreshing instance network info cache due to event network-changed-f12df099-5d7b-4c36-94ad-18005138cff3. {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 19:39:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] Acquiring lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:39:45 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] Acquired lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:39:45 user nova-compute[75235]: DEBUG nova.network.neutron [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Refreshing network info cache for port f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 19:39:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updated VIF entry in instance network info cache for port f12df099-5d7b-4c36-94ad-18005138cff3. {{(pid=75235) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 19:39:46 user nova-compute[75235]: DEBUG nova.network.neutron [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:39:46 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-2140cfab-2040-40f6-8221-1820f2be718b req-6f76c65c-64de-4113-9a16-9e37590e7c7b service nova] Releasing lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:39:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG nova.objects.instance [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:39:48 user nova-compute[75235]: INFO nova.compute.manager [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Attaching volume 05a781ae-4ac3-4d4b-9144-4499d0a5e7fc to /dev/vdb
Nov 29 19:39:48 user nova-compute[75235]: DEBUG os_brick.utils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d1fb2e-aad3-496a-a9f5-56685c43a34a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:278f64df1b75\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c80b418-8cb9-41c7-9f52-5e4defcbd5c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954ae9a-4930-4c5b-b793-288947264a62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff361f2c-462d-458e-a1d0-783cc5ec9d9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Running cmd (subprocess): nvme version {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] 'nvme version' failed. Not Retrying. {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] nvme not present on system {{(pid=75235) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 19:39:48 user nova-compute[75235]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 19:39:48 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a52b500-0395-4acc-950e-a89f5e13e7a4]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75235) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.lightos [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] LIGHTOS: no hostnqn found. {{(pid=75235) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG os_brick.utils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:278f64df1b75', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:39:48 user nova-compute[75235]: DEBUG nova.virt.block_device [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating existing volume attachment record: b97e6874-d089-42ed-9b5c-9d1fc81dd652 {{(pid=75235) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 19:39:50 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:52 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Calling os-brick to attach iSCSI Volume {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iExcGTFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:39:55 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:39:55 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:39:55 user nova-compute[75235]: INFO os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf500d-0e8d-435b-8211-bd4e90edac92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 19:39:55 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a528cf-32a5-4773-88d0-1def6db1664a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc] added
Nov 29 19:39:55 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b434ba-6752-4762-8c74-e4dad47950da]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58e3c81-dc14-49dc-8b6e-cb9a03bd3f0b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:55 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iExcGTFQ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iExcGTFQ" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d2713-2d1f-40e5-9c3f-4e9c09939a3d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iExcGTFQ'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9803eae-83dd-42d0-a713-260ed5f77bf4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27292ea-7248-4258-956f-1ce0ae35b6e4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:39:56 user nova-compute[75235]:  {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 19:39:56 user nova-compute[75235]:  {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:39:56 user nova-compute[75235]: WARNING os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 19:39:56 user nova-compute[75235]: 
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d98d1-1b25-417a-bddd-88a57af782f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260]
Nov 29 19:39:56 user nova-compute[75235]: Login to [iface: default, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260] successful.
Nov 29 19:39:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0bc535-57c7-434d-bd64-b16a57a3689f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99c70b-452f-47e6-84f9-5a24e47a3829]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc (non-flash)
Nov 29 19:39:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc (non-flash)
Nov 29 19:39:56 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Connected to 172.16.0.220:3260 {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75235) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75235) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75c5603-1fcc-490b-94b1-c88d131aa571]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:39:56 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75235) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iExcGTFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75235) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23537633233356565', 'path': '/dev/sdb'} {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537633233356565', 'path': '/dev/sdb'} {{(pid=75235) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG nova.objects.instance [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 19:39:57 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:39:57 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:39:57 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:39:57 user nova-compute[75235]:   <serial>05a781ae-4ac3-4d4b-9144-4499d0a5e7fc</serial>
Nov 29 19:39:57 user nova-compute[75235]: </disk>
Nov 29 19:39:57 user nova-compute[75235]:  {{(pid=75235) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75235) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] No VIF found with MAC fa:16:3e:e5:4e:bc, not building metadata {{(pid=75235) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 19:39:57 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-95adc150-cc55-4b27-8033-0a19e5cfe58f tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.124s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:39:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:39:58 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:39:58 user nova-compute[75235]: INFO nova.compute.manager [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Detaching volume 05a781ae-4ac3-4d4b-9144-4499d0a5e7fc
Nov 29 19:39:58 user nova-compute[75235]: INFO nova.virt.block_device [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Attempting to driver detach volume 05a781ae-4ac3-4d4b-9144-4499d0a5e7fc from mountpoint /dev/vdb
Nov 29 19:39:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Attempting to detach device vdb from instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 from the persistent domain config. {{(pid=75235) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 19:39:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:39:58 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:39:58 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:39:58 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:39:58 user nova-compute[75235]:   <serial>05a781ae-4ac3-4d4b-9144-4499d0a5e7fc</serial>
Nov 29 19:39:58 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:39:58 user nova-compute[75235]: </disk>
Nov 29 19:39:58 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:39:58 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully detached device vdb from instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 from the persistent domain config.
Nov 29 19:39:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 from the live domain config. {{(pid=75235) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 19:39:58 user nova-compute[75235]: DEBUG nova.virt.libvirt.guest [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 19:39:58 user nova-compute[75235]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 19:39:58 user nova-compute[75235]:   <source dev="/dev/sdb"/>
Nov 29 19:39:58 user nova-compute[75235]:   <target dev="vdb" bus="virtio"/>
Nov 29 19:39:58 user nova-compute[75235]:   <serial>05a781ae-4ac3-4d4b-9144-4499d0a5e7fc</serial>
Nov 29 19:39:58 user nova-compute[75235]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 19:39:58 user nova-compute[75235]: </disk>
Nov 29 19:39:58 user nova-compute[75235]:  {{(pid=75235) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 19:39:59 user nova-compute[75235]: DEBUG nova.virt.libvirt.driver [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 19:40:02 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:05 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:07 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:40:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:12 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:40:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:17 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:19 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 is timed out.
Nov 29 19:40:19 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully detached device vdb from instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 from the live domain config.
Nov 29 19:40:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] calling os-brick to detach iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5658138e50>, {'target_iqn': 'iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iExcGTFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 19:40:19 user nova-compute[75235]: WARNING os_brick.initiator.connectors.base [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06cd1f-523a-4fde-9a16-4d3a87ed83a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 19:40:19 user nova-compute[75235]: No targets found.
Nov 29 19:40:19 user nova-compute[75235]: iSNS:
Nov 29 19:40:19 user nova-compute[75235]: No targets found.
Nov 29 19:40:19 user nova-compute[75235]: STATIC:
Nov 29 19:40:19 user nova-compute[75235]: Target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc
Nov 29 19:40:19 user nova-compute[75235]:         Portal: 172.16.0.220:3260,-1
Nov 29 19:40:19 user nova-compute[75235]:                 Iface Name: default
Nov 29 19:40:19 user nova-compute[75235]: FIRMWARE:
Nov 29 19:40:19 user nova-compute[75235]: No targets found.
Nov 29 19:40:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 19:40:19 user nova-compute[75235]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 19:40:19 user nova-compute[75235]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75235) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc', 0)] {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[15178ca6-b1a3-4f0a-b44c-cc8fdedc1d39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f180f80-8268-4bc8-83ab-e2e3e5a488e0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc (non-flash)
Nov 29 19:40:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc (non-flash)
Nov 29 19:40:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f565052dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc'): ({'sdb'}, set())}) {{(pid=75235) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Removing single pathed devices sdb {{(pid=75235) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80965e8-3806-4f05-819c-3df8308fd85c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[436187df-3f59-4589-86f9-2379bc353bd7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Flushing IO for device /dev/sdb {{(pid=75235) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[dced555e-5af7-4633-ba29-116f24ab0769]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75235) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333fbee-6487-4184-9ce4-fbd06a516854]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.linuxscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] SCSI volumes sdb have been removed. {{(pid=75235) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc')] {{(pid=75235) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b220432-7d89-4320-a4b3-47eedd5af617]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b21c1fd-2779-4eb5-8564-4762fcd53f23]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260]
Nov 29 19:40:19 user nova-compute[75235]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc, portal: 172.16.0.220,3260] successful.
Nov 29 19:40:19 user nova-compute[75235]:  stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05a781ae-4ac3-4d4b-9144-4499d0a5e7fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e65fa04-d2d4-4eec-9936-7e7aa4f09562]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75235) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.base [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] <== disconnect_volume: return (282ms) None {{(pid=75235) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 19:40:19 user nova-compute[75235]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Disconnected iSCSI Volume {{(pid=75235) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 19:40:20 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:20 user nova-compute[75235]: DEBUG nova.objects.instance [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'flavor' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:40:20 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-7d6df32d-ef21-495e-8726-c81ff08a461e tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.610s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:22 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:24 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG oslo_concurrency.processutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 19:40:25 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:40:25 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.08465576171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75235) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:40:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:27 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquired lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Forcefully refreshing network info cache for instance {{(pid=75235) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 19:40:31 user nova-compute[75235]: DEBUG nova.objects.instance [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lazy-loading 'info_cache' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG nova.network.neutron [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [{"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Releasing lock "refresh_cache-05b2fbb1-7292-431c-b2a3-041b4d43bc00" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updated the network info_cache for instance {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:32 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:40:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:40:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:37 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:40:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:40:42 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:47 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:49 user nova-compute[75235]: INFO nova.compute.manager [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Terminating instance
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.compute.manager [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Start destroying the instance on the hypervisor. {{(pid=75235) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-9a4f8f72-631c-4ec8-b3eb-a86a376b102b req-ab02a41e-90a3-4d33-b4f4-71791e7f4e25 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-vif-unplugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9a4f8f72-631c-4ec8-b3eb-a86a376b102b req-ab02a41e-90a3-4d33-b4f4-71791e7f4e25 service nova] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9a4f8f72-631c-4ec8-b3eb-a86a376b102b req-ab02a41e-90a3-4d33-b4f4-71791e7f4e25 service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-9a4f8f72-631c-4ec8-b3eb-a86a376b102b req-ab02a41e-90a3-4d33-b4f4-71791e7f4e25 service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-9a4f8f72-631c-4ec8-b3eb-a86a376b102b req-ab02a41e-90a3-4d33-b4f4-71791e7f4e25 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] No waiting events found dispatching network-vif-unplugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.compute.manager [req-9a4f8f72-631c-4ec8-b3eb-a86a376b102b req-ab02a41e-90a3-4d33-b4f4-71791e7f4e25 service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-vif-unplugged-f12df099-5d7b-4c36-94ad-18005138cff3 for instance with task_state deleting. {{(pid=75235) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [-] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Instance destroyed successfully.
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.objects.instance [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lazy-loading 'resources' on Instance uuid 05b2fbb1-7292-431c-b2a3-041b4d43bc00 {{(pid=75235) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.virt.libvirt.vif [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T19:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-540761815',display_name='tempest-AttachVolumeNegativeTest-server-540761815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-540761815',id=52,image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/rL7Jd6wI697nQgymzVMz4JK/JnnxG/vaE0zf0TzmNHmUOt/FE9w7OBZ4mmBXxFRvDrffuUzMwSWzimSBxJWYAiP5aMS8FlVaWrHCGRrWX7AjVLvrq47D89xQJ6i4HnA==',key_name='tempest-keypair-396601116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T19:38:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2594a91424a6408a9c6c57d5364bc9bb',ramdisk_id='',reservation_id='r-1zlhj06q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2df0cf47-6e1a-495b-92f5-27a94d1b3217',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1078373175',owner_user_name='tempest-AttachVolumeNegativeTest-1078373175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T19:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c44ac18976b4232a45bedacf9177023',uuid=05b2fbb1-7292-431c-b2a3-041b4d43bc00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converting VIF {"id": "f12df099-5d7b-4c36-94ad-18005138cff3", "address": "fa:16:3e:e5:4e:bc", "network": {"id": "183d95f5-61cd-48ca-a001-24a910d13f9b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-942962005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2594a91424a6408a9c6c57d5364bc9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12df099-5d", "ovs_interfaceid": "f12df099-5d7b-4c36-94ad-18005138cff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.network.os_vif_util [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d') {{(pid=75235) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG os_vif [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d') {{(pid=75235) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf12df099-5d, bridge=br-int, if_exists=True) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9d26d17-3460-4902-bab2-451fdd2c9fd0) {{(pid=75235) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:40:49 user nova-compute[75235]: INFO os_vif [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:4e:bc,bridge_name='br-int',has_traffic_filtering=True,id=f12df099-5d7b-4c36-94ad-18005138cff3,network=Network(183d95f5-61cd-48ca-a001-24a910d13f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12df099-5d')
Nov 29 19:40:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Deleting instance files /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00_del
Nov 29 19:40:49 user nova-compute[75235]: INFO nova.virt.libvirt.driver [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Deletion of /opt/stack/data/nova/instances/05b2fbb1-7292-431c-b2a3-041b4d43bc00_del complete
Nov 29 19:40:49 user nova-compute[75235]: INFO nova.compute.manager [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 19:40:49 user nova-compute[75235]: DEBUG oslo.service.loopingcall [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75235) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.compute.manager [-] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Deallocating network for instance {{(pid=75235) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 19:40:49 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] deallocate_for_instance() {{(pid=75235) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 19:40:50 user nova-compute[75235]: DEBUG nova.network.neutron [-] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Updating instance_info_cache with network_info: [] {{(pid=75235) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 19:40:50 user nova-compute[75235]: INFO nova.compute.manager [-] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Took 0.86 seconds to deallocate network for instance.
Nov 29 19:40:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:50 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:50 user nova-compute[75235]: DEBUG nova.compute.manager [req-45b89849-71f3-48b8-912e-141148b7cb1f req-52579c3b-bffa-4cad-bff4-41689cc62d6f service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-vif-deleted-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:40:50 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:40:50 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:40:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:51 user nova-compute[75235]: INFO nova.scheduler.client.report [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Deleted allocations for instance 05b2fbb1-7292-431c-b2a3-041b4d43bc00
Nov 29 19:40:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-afcefc93-277c-4963-99ca-338eaeae74f9 tempest-AttachVolumeNegativeTest-1078373175 tempest-AttachVolumeNegativeTest-1078373175-project-member] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-1846e3da-4016-439e-b3a0-81183418346a req-4a518fd5-2c89-4d92-a352-89586c90c75d service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received event network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 19:40:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1846e3da-4016-439e-b3a0-81183418346a req-4a518fd5-2c89-4d92-a352-89586c90c75d service nova] Acquiring lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:40:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1846e3da-4016-439e-b3a0-81183418346a req-4a518fd5-2c89-4d92-a352-89586c90c75d service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:40:51 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [req-1846e3da-4016-439e-b3a0-81183418346a req-4a518fd5-2c89-4d92-a352-89586c90c75d service nova] Lock "05b2fbb1-7292-431c-b2a3-041b4d43bc00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:40:51 user nova-compute[75235]: DEBUG nova.compute.manager [req-1846e3da-4016-439e-b3a0-81183418346a req-4a518fd5-2c89-4d92-a352-89586c90c75d service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] No waiting events found dispatching network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 {{(pid=75235) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 19:40:51 user nova-compute[75235]: WARNING nova.compute.manager [req-1846e3da-4016-439e-b3a0-81183418346a req-4a518fd5-2c89-4d92-a352-89586c90c75d service nova] [instance: 05b2fbb1-7292-431c-b2a3-041b4d43bc00] Received unexpected event network-vif-plugged-f12df099-5d7b-4c36-94ad-18005138cff3 for instance with vm_state deleted and task_state None.
Nov 29 19:40:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:40:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75235) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 19:41:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:41:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75235) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 19:41:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:21 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:41:25 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:41:25 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:41:25 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=9159MB free_disk=25.111888885498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:41:25 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:41:26 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:41:26 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:41:26 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:41:26 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:41:26 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:41:26 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:41:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:28 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:30 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:32 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:41:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:41:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:41:33 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:33 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:49 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:41:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:41:56 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:41:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:14 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:42:17 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:17 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75235) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 19:42:19 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:42:21 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:23 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:24 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:26 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:26 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75235) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75235) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 19:42:27 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:42:27 user nova-compute[75235]: WARNING nova.virt.libvirt.driver [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 19:42:27 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=25.109657287597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75235) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 19:42:27 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 19:42:28 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 19:42:28 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75235) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 19:42:28 user nova-compute[75235]: DEBUG nova.compute.provider_tree [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed in ProviderTree for provider: 5d984797-93a3-43d0-9a35-bb500b1e869a {{(pid=75235) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 19:42:28 user nova-compute[75235]: DEBUG nova.scheduler.client.report [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Inventory has not changed for provider 5d984797-93a3-43d0-9a35-bb500b1e869a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75235) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 19:42:28 user nova-compute[75235]: DEBUG nova.compute.resource_tracker [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Compute_service record updated for user:user {{(pid=75235) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 19:42:28 user nova-compute[75235]: DEBUG oslo_concurrency.lockutils [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=75235) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 19:42:29 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:29 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:29 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:42:32 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Starting heal instance info cache {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 19:42:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Rebuilding the list of instances to heal {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 19:42:32 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Didn't find any instances for network info cache update. {{(pid=75235) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 19:42:32 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:34 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:34 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:34 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:39 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:44 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:49 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:49 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:53 user nova-compute[75235]: DEBUG oslo_service.periodic_task [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75235) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 19:42:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] Cleaning up deleted instances {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 19:42:53 user nova-compute[75235]: DEBUG nova.compute.manager [None req-64c58612-4ea1-4f56-a1e1-78f49fa26b36 None None] There are 0 instances to clean {{(pid=75235) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 19:42:54 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:42:59 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 19:43:04 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 19:43:09 user nova-compute[75235]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=75235) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}